Author Topic: Some stats missing.  (Read 11625 times)

Offline Azzura

  • Full Member
  • ***
  • Posts: 155
  • Karma: 70
  • Gender: Male
    • Dargaville Weather, New Zealand (Mahuta Rd)
Some stats missing.
« on: July 11, 2012, 08:34:42 AM »
I seem to be missing some stats for the entire month of June not displaying on my site.

If you go to my Stations Reports are on my web site - http://mahutaweather.no-ip.org/wxtempdetail.php.

Initially nothing was being reported for the month of June (2012) column. I manged to get some data back by doing some updates and converts in WD (Noaa reports area).

The data in the Temp, Rain, Wind and Wind Run areas has been populated.

Yet in the Barometric Pressure, Sunshine Hours, Max Solar, UV, Dew Point and Wet Bulb is still missing in action for June 2012.  :'(


Dargaville Weather, New Zealand (Mahuta Rd)- Vantage Pro2 Plus with Fan-Aspirated Radiation Shield

Only when the last tree has died, the last river has been poisoned and the last fish has been caught, will we realize that we cannot eat money. -Cree Proverb

Offline TokWW

  • Grim
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1579
  • Country: 00
  • Karma: 196
  • Gender: Male
  • Another Engineer
    • Tokoroa North Weather
Re: Some stats missing.
« Reply #1 on: July 11, 2012, 08:45:45 AM »
Azzura, did you shut the WX PC down at any stage during the month - a power crash, a Windows Update or something?  There is a posibility that the logfile was corrupted and some stats algorithms can read the data and others not.  The solar data is in a different file too.  But Baro, DB and WB are in the master file.  WD tries to download the missing data from the datalogger of the weather station but sometimes has an overlap of minutes which can corrupt/upset the stat and graphing functions.

I can help further with logfile errors if you think it may have become damaged.

Offline Azzura

  • Full Member
  • ***
  • Posts: 155
  • Karma: 70
  • Gender: Male
    • Dargaville Weather, New Zealand (Mahuta Rd)
Re: Some stats missing.
« Reply #2 on: July 11, 2012, 09:23:54 AM »
TokWW,

No computer crashes, no Windows updates....no issues that I can think of. The computer is a little netbook with a 10hr battery. So even during power outages..the system stays up and the Davis unit has battery backup as well. I may have done a reboot...but WD was saved and exited.

I can view the stats in question in the Noaa reports area of WD. I don't think the files are corrupt?

Are there some files I could attached?

Offline TokWW

  • Grim
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1579
  • Country: 00
  • Karma: 196
  • Gender: Male
  • Another Engineer
    • Tokoroa North Weather
Re: Some stats missing.
« Reply #3 on: July 11, 2012, 09:37:02 AM »
Have pm'd you, different items to check for and discuss.  I will find a logfile check utility.

OK I have found a link to the author's website for the Logfile error detection Utility listed at the top of the table here:

http://www.websterweatherlive.com/wxScripts.php#L4

It is a DOS based utility so needs Win XP to run I believe.

Weather Display needs to be on the root of C:\wdisplay 

There should be a Readme.txt file - read that to ensure the utility is installed in the correct place too :)
« Last Edit: July 11, 2012, 09:49:36 AM by TokWW »

Offline Deano

  • Financial Supporter
  • Hero Member
  • *****
  • Posts: 1330
  • Country: nz
  • Karma: 459
  • Gender: Male
    • Kaipara Weather
  • Station: DavisVP2
Re: Some stats missing.
« Reply #4 on: July 11, 2012, 09:48:36 AM »
Azzura, your missing data is in the climatedataout file. Make sure that file exists for the month in question.

Sent from my GT-I9300 using Tapatalk 2
Weather Display 10.37s
Saratoga Template V3
Davis VP2

Offline TokWW

  • Grim
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1579
  • Country: 00
  • Karma: 196
  • Gender: Male
  • Another Engineer
    • Tokoroa North Weather
Re: Some stats missing.
« Reply #5 on: July 11, 2012, 10:01:41 AM »
The data he is talking about should be in this file : climatedataout62012.html located in your \webfiles foler.

I have just see a very smart layput for this data... on the logfile utility author's website:

http://www.websterweatherlive.com/climatedataout62012.html

Nicely laid out page...

Offline Azzura

  • Full Member
  • ***
  • Posts: 155
  • Karma: 70
  • Gender: Male
    • Dargaville Weather, New Zealand (Mahuta Rd)
Re: Some stats missing.
« Reply #6 on: July 11, 2012, 10:34:24 AM »

I am indeed missing the file you mention Deano. How to I create one?
« Last Edit: July 11, 2012, 10:36:08 AM by Azzura »

Offline Azzura

  • Full Member
  • ***
  • Posts: 155
  • Karma: 70
  • Gender: Male
    • Dargaville Weather, New Zealand (Mahuta Rd)
Re: Some stats missing.
« Reply #7 on: July 11, 2012, 10:38:59 AM »
Going to try an answer my own question ...

Is it in Noaa averages/extremes/reports.....Do I recreate the Web Av/Ext page?

Offline TokWW

  • Grim
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1579
  • Country: 00
  • Karma: 196
  • Gender: Male
  • Another Engineer
    • Tokoroa North Weather
Re: Some stats missing.
« Reply #8 on: July 11, 2012, 10:39:26 AM »
Go to [View] - [Averages/Extremes] right hand end tab [Detailed Climate Report] and follow through some setups on there - best with a wide screen... and you can select a month and it will create a new file without the month and year tag in the title so it would be climatedataout.html and sit in the \webfiles folder.  It would need to be renamed as in above post.

Offline Azzura

  • Full Member
  • ***
  • Posts: 155
  • Karma: 70
  • Gender: Male
    • Dargaville Weather, New Zealand (Mahuta Rd)
Re: Some stats missing.
« Reply #9 on: July 11, 2012, 10:47:09 AM »
Success!

Breathing a little easier now...thanks guys!

Any ideas on why Solar kWh doesn't want to report any data. It reports only for the day in question...with no data retention.
« Last Edit: July 11, 2012, 10:56:14 AM by Azzura »

Offline JennyLeez

  • Administrator
  • Hero Member
  • *****
  • Posts: 10088
  • Country: nz
  • Karma: 655
  • Gender: Female
  • Wairoa
    • Wairoa, Hawkes Bay Weather
  • Station: WS3085
Re: Some stats missing.
« Reply #10 on: July 11, 2012, 11:32:29 AM »

ah ha Deano. Thats what runs this then.
Thank you :)

http://kaiparaweather.homeip.net:81/weather/wxraindetail.php
Living in Wairoa, Northern Hawkes Bay
Website: wairoa.net/weather

Offline JennyLeez

  • Administrator
  • Hero Member
  • *****
  • Posts: 10088
  • Country: nz
  • Karma: 655
  • Gender: Female
  • Wairoa
    • Wairoa, Hawkes Bay Weather
  • Station: WS3085
Re: Some stats missing.
« Reply #11 on: July 11, 2012, 11:34:40 AM »
climatedataout62012.html[/b] located in your \webfiles foler.

I have just see a very smart layput for this data... on the logfile utility author's website:

http://www.websterweatherlive.com/climatedataout62012.html

Nicely laid out page...

Much tidier:

http://www.mangawhaiweather.co.nz/wxclimate.php

Offline TokWW

  • Grim
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1579
  • Country: 00
  • Karma: 196
  • Gender: Male
  • Another Engineer
    • Tokoroa North Weather
Re: Some stats missing.
« Reply #12 on: July 11, 2012, 11:39:07 AM »
I agree - very sweet and compact.

Offline JennyLeez

  • Administrator
  • Hero Member
  • *****
  • Posts: 10088
  • Country: nz
  • Karma: 655
  • Gender: Female
  • Wairoa
    • Wairoa, Hawkes Bay Weather
  • Station: WS3085
Re: Some stats missing.
« Reply #13 on: July 11, 2012, 03:35:41 PM »
climatedataout62012.html[/b] located in your \webfiles foler.
I have just see a very smart layput for this data... on the logfile utility author's website:
http://www.websterweatherlive.com/climatedataout62012.html
Nicely laid out page...

Ok now this is a repetition of the dailynoaareports.

I have two members and they both only have dailyreportnoaareports.html and climatedataout.html.
This file continues to upload at the change of the month but the month before is not renamed with the month and year.
They have nothing else on their server.
Hence no history other than the current month.
I dont get this at all. I have gone through WD with a fine tooth comb and can not find how to make it rename the month before and upload it. Very frustrating :( :( :(
Looks like I shall have to make a fool of myself and post on the WD forum :( :( :(

Offline TokWW

  • Grim
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1579
  • Country: 00
  • Karma: 196
  • Gender: Male
  • Another Engineer
    • Tokoroa North Weather
Re: Some stats missing.
« Reply #14 on: July 11, 2012, 05:42:19 PM »
Brian Hamilton - AKA Weather-Watch is on vacation and working on compiling 1m lines of code for the MAC version.  It is hard to browse through my WD PC as it has monitor on tall freezer and keyboard leaning against the wall, mouse is free without a table top...  I will have a further look in other corners.

Offline TokWW

  • Grim
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1579
  • Country: 00
  • Karma: 196
  • Gender: Male
  • Another Engineer
    • Tokoroa North Weather
Re: Some stats missing.
« Reply #15 on: July 11, 2012, 06:27:13 PM »
If using the Customise FTP in [Control Panel] - [Internet File Creation and Upload]  then ensure that File #41 is setup.

The normal reason that these files are not created is that the PC is underpowered or has inadequate ram and everything is trying to happen at 8min past midnight.  May be worse with a Davis wx stn as it talks every 2.5secs to the PC.  A whole lot of things have to happen inside 60secs before the minute data is stored and converted to digital data and recreate the graphs, otherwise you need a good amount of ram - ie about 1GB would be minimum, many older PC's or laptops will only have 512MB.

Offline JennyLeez

  • Administrator
  • Hero Member
  • *****
  • Posts: 10088
  • Country: nz
  • Karma: 655
  • Gender: Female
  • Wairoa
    • Wairoa, Hawkes Bay Weather
  • Station: WS3085
Re: Some stats missing.
« Reply #16 on: July 11, 2012, 08:43:18 PM »
 - [Internet File Creation and Upload]  then ensure that File #41 is setup.

The normal reason that these files are not created is that the PC is underpowered or has inadequate ram and everything is trying to happen at 8min past midnight.  May be worse with a Davis wx stn as it talks every 2.5secs to the PC.  A whole lot of things have to happen inside 60secs before the minute data is stored and converted to digital data and recreate the graphs, otherwise you need a good amount of ram - ie about 1GB would be minimum, many older PC's or laptops will only have 512MB.
Yep I have them both setting up 41 but I am not pinning my hopes on that.
I dont think the PC or ram is the problem. WD is not uploading a huge amount for these WX templates. They dont need to compared to the standard WD web site. A lot of the graphics are not used for a start.
Most uploads are coming from Internet file creation and we have different times for these so their is not the crowding you speak of. Not only that one would expect at least 1 or 2 would be uploaded over 3 years huh.
Thanks for your help Toko. When have time I will head back to the WD forum.
Cheers

Offline TokWW

  • Grim
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1579
  • Country: 00
  • Karma: 196
  • Gender: Male
  • Another Engineer
    • Tokoroa North Weather
Re: Some stats missing.
« Reply #17 on: July 11, 2012, 09:08:15 PM »
There is still a lot of cpu load due to eom stats saved - it has been the issue and main cause in the past 12 years of WD operation and is why it was shifted to 8mins past midnight after a possible 5min past hour uploads - eg webcam images and data manipulationvplus normal wx calcs and file updates.


Share via twitter

xx
Local Weather Map missing??

Started by saratogaWX

17 Replies
12832 Views
Last post February 03, 2021, 10:57:10 PM
by Wolfie33
xx
8 missing after fishing boat capsizes

Started by Suezy

0 Replies
8568 Views
Last post March 15, 2012, 10:31:02 PM
by Suezy
xx
Slovakian hitchhiker missing in Tasman

Started by Suezy

1 Replies
2694 Views
Last post April 09, 2012, 08:34:50 PM
by Suezy
xx
Storm Kai-tak: Philippines landslides kill 26, more missing

Started by Martin4Jay

0 Replies
7731 Views
Last post December 18, 2017, 10:08:10 AM
by Martin4Jay
xx
26 killed, 60 fishermen missing in Bangladesh storm

Started by Mark

0 Replies
4113 Views
Last post October 13, 2012, 08:34:55 AM
by Mark
 


Visit GeoNet for the latest Earthquakes across New Zealand head to GeoNet.