Author Topic: Data logging window disappeared at startup  (Read 13321 times)

Offline choc-a-holic

  • Full Member
  • ***
  • Posts: 102
  • Karma: 9
    • Worlds Our Oyster
Re: Data logging window disappeared at startup
« Reply #20 on: March 30, 2016, 04:38:25 PM »
Have pm'ed details to you  :)
Mahana, Tasman - WMR200

Offline gabba

  • Financial Supporter
  • Hero Member
  • *****
  • Posts: 2153
  • Country: 00
  • Karma: 213
  • Gender: Male
    • Hutt Weather
  • Station: Vantage Vue, Weather Display, Webcam.
Re: Data logging window disappeared at startup
« Reply #21 on: March 30, 2016, 09:51:46 PM »
Have done some hunting around but so far no luck. I dropped the clientraw file into an editor and all seems fine there, although I didn't check it down to data field level.

I dug out some reporting, which I've attached. As an example of a successful file read I've included mine. What it suggests is that it locates the file correctly but for some reason doesn't want to read it. Anyone with any other thoughts?

So at this stage I'd like to look at the file being uploaded to an account on this server. I can have a better play with the script and also check a few other things  that may point to something
Cheers, Andrew

Vantage Vue, Weather Display, Webcam.
www.huttweather.co.nz

Maungaraki, Lower Hutt, New Zealand

Offline JennyLeez

  • Administrator
  • Hero Member
  • *****
  • Posts: 10088
  • Country: nz
  • Karma: 655
  • Gender: Female
  • Wairoa
    • Wairoa, Hawkes Bay Weather
  • Station: WS3085
Re: Data logging window disappeared at startup
« Reply #22 on: March 30, 2016, 11:16:56 PM »
Gabba I am pointing you back to beteljuice's post:

Quote
Something weird going on, but I don't know what !

The content is gzipped which is not a problem.
This is prefixed by hex 0d0a, which shouldn't be a problem but is !!

The scripts look for and remove the leading 0d0a but from this server for some reason the check method isn't recognizing the 0d0a ?

If I rewrite the check method a different way it works.

So there is the reason why. Very strange as for years on her server it has been fine. Since the PC crash and upgrade it has not. The clientraw.txt is fine Gabba. I have compared each data entry against Brian's clientraw.txt as he is running the same version.

Now while betel can fix the Data Summary script it is not going to fix the Map script.

Quote
I can have a better play with the script...
You also better be careful with your playing...lol

Tomorrow we will test the clientraw.txt on another server.
I will let you know how we get on.

Sending the second instance of her clientraw to the forum server may be our only option.

Cheers.
« Last Edit: March 30, 2016, 11:18:35 PM by JennyLeez »
Living in Wairoa, Northern Hawkes Bay
Website: wairoa.net/weather

Offline gabba

  • Financial Supporter
  • Hero Member
  • *****
  • Posts: 2153
  • Country: 00
  • Karma: 213
  • Gender: Male
    • Hutt Weather
  • Station: Vantage Vue, Weather Display, Webcam.
Re: Data logging window disappeared at startup
« Reply #23 on: March 31, 2016, 12:30:29 AM »
Something weird going on, but I don't know what !

The content is gzipped which is not a problem.
This is prefixed by hex 0d0a, which shouldn't be a problem but is !!

The scripts look for and remove the leading 0d0a but from this server for some reason the check method isn't recognizing the 0d0a ?

If I rewrite the check method a different way it works.
So there is the reason why. Very strange as for years on her server it has been fine. Since the PC crash and upgrade it has not. The clientraw.txt is fine Gabba. I have compared each data entry against Brian's clientraw.txt as he is running the same version.

Now while betel can fix the Data Summary script it is not going to fix the Map script.


Tomorrow we will test the clientraw.txt on another server.
I will let you know how we get on.

Sending the second instance of her clientraw to the forum server may be our only option.

Cheers.
[/quote]

More random thoughts...
Does Brian's file also have the 0d0a hex character? If I read it right the 0d0a character appears at the start of the txt string? It seems strange that WD would start adding that code now, on that PC, after a rebuild, and presumably not on anyone elses who have upgraded to that version (or at least this is the only instance where the code to remove the hex code is being executed) - so it's rather odd!

I've got older versions of WD here - I wonder what would happen if we downgraded?

It's probably worthwhile us both doing the server tests. While the scripts are based on the same code (I believe) the servers will be configured differently. I know I'm clutching at straws a bit going down the server route, but the worst thing that can happen is that we both validate what each other find ;-)

Cheers

Offline Weather Display

  • Hero Member
  • *****
  • Posts: 517
  • Karma: 77
  • Gender: Male
    • Weather Display
Re: Data logging window disappeared at startup
« Reply #24 on: March 31, 2016, 07:48:05 AM »
0a0d are control characters, line return and carriage return
but WD does not add those, I suggest the server is adding those

Brian
Awhitu, SW of Auckland

Offline beteljuice

  • Full Member
  • ***
  • Posts: 172
  • Country: 00
  • Karma: 41
Re: Data logging window disappeared at startup
« Reply #25 on: March 31, 2016, 10:21:04 AM »
It would be / is from the server.

It is an optional prefix to the 'magic number(s)' of whatever the server has done. (eg. gzip and / or block encoding)

Looking at the binhex string following the headers everthing looks OK.
... but the scripts fail to do a simple search and remove operation for some unseen reason !
Imagine what you will KNOW tomorrow

Offline Weather Display

  • Hero Member
  • *****
  • Posts: 517
  • Karma: 77
  • Gender: Male
    • Weather Display
Re: Data logging window disappeared at startup
« Reply #26 on: March 31, 2016, 12:31:06 PM »
it could be that somehow the server is set to ascii mode or similar?

Offline gabba

  • Financial Supporter
  • Hero Member
  • *****
  • Posts: 2153
  • Country: 00
  • Karma: 213
  • Gender: Male
    • Hutt Weather
  • Station: Vantage Vue, Weather Display, Webcam.
Re: Data logging window disappeared at startup
« Reply #27 on: March 31, 2016, 01:08:46 PM »
Yes - that was my thinking too - I haven't seen the FTP log yet , but should hopefully be able to tell when I get home tonight, by looking at the FTP log on the (this) server side

Offline gabba

  • Financial Supporter
  • Hero Member
  • *****
  • Posts: 2153
  • Country: 00
  • Karma: 213
  • Gender: Male
    • Hutt Weather
  • Station: Vantage Vue, Weather Display, Webcam.
Re: Data logging window disappeared at startup
« Reply #28 on: April 01, 2016, 02:32:49 PM »
Another curly one - we are using the panel in WD that allows two FTP servers to be set up.

The first FTP server works fine, and I can browse to the clientraw.txt and see it

The second FTP server gets a file of 0KB, and when it's opened up it is blank. It occasionally (roughly hourly) gets a valid file, which is then overwritten by a blank file about 10 mins later as per the ftp schedule.

Has anyone seen this behaviour before?

I've had mixed results in using the files I have managed to get on the server, so no final solution yet

Offline Weather Display

  • Hero Member
  • *****
  • Posts: 517
  • Karma: 77
  • Gender: Male
    • Weather Display
Re: Data logging window disappeared at startup
« Reply #29 on: April 01, 2016, 06:48:51 PM »
if you can , set to use passive mode and set to rename the file too on the server

Offline gabba

  • Financial Supporter
  • Hero Member
  • *****
  • Posts: 2153
  • Country: 00
  • Karma: 213
  • Gender: Male
    • Hutt Weather
  • Station: Vantage Vue, Weather Display, Webcam.
Re: Data logging window disappeared at startup
« Reply #30 on: April 01, 2016, 07:34:53 PM »
passive mode seems to have worked. Just doing final testing, but it looks like it works uploaded to this server, but not if the file is pulled from the other server

If that's the case we can do some troubleshooting from there, but at least we have a working solution.

Next step I think is to do a compare between the two setups and the two logs. If the are largely identical then I think the original FTP server would be the problem.

Cheers and thanks

Offline Weather Display

  • Hero Member
  • *****
  • Posts: 517
  • Karma: 77
  • Gender: Male
    • Weather Display
Re: Data logging window disappeared at startup
« Reply #31 on: April 01, 2016, 08:18:11 PM »
I put my money on a problem with the server

Offline JennyLeez

  • Administrator
  • Hero Member
  • *****
  • Posts: 10088
  • Country: nz
  • Karma: 655
  • Gender: Female
  • Wairoa
    • Wairoa, Hawkes Bay Weather
  • Station: WS3085
Re: Data logging window disappeared at startup
« Reply #32 on: April 01, 2016, 08:42:04 PM »
Yep agree which is what I advised choc-a a week ago.

Choc-a I know your server does not want to know about this but perhaps you could link them to this thread and then they can read down for themselves.

Your clientraw.txt has been uploaded now to 2 other servers and our scripts can read it without a hitch.

These same scripts are reading hundreds of clientraw.txt files around the world. Tell them it is not our scripts but what they adding at their end.

Give this to your server:
Quote
The content is gzipped which is not a problem.
This is prefixed by hex 0d0a, which shouldn't be a problem but is !!

Quote
0a0d are control characters, line return and carriage return
but WD does not add those, I suggest the server is adding those

Quote
It would be / is from the server.

It is an optional prefix to the 'magic number(s)' of whatever the server has done. (eg. gzip and / or block encoding)

Looking at the binhex string following the headers everthing looks OK.
... but the scripts fail to do a simple search and remove operation for some unseen reason !



Share via twitter

clip
Wind gust recorded in WD and then disappeared.

Started by Azzura

2 Replies
3780 Views
Last post May 07, 2013, 08:44:09 PM
by Deano
xx
Notice of Upcoming maintenance window - April 27

Started by gabba

1 Replies
5857 Views
Last post April 21, 2012, 05:11:57 PM
by ato2
xx
Notice of Upcoming Maintenance Window - 19 October

Started by gabba

0 Replies
5637 Views
Last post October 18, 2012, 09:12:44 PM
by gabba
xx
Planned Maintenance Window: 17th Nov 8pm to 10pm

Started by gabba

3 Replies
6319 Views
Last post November 16, 2016, 09:09:01 PM
by gabba
exclamation
Notice of Upcoming Forum Maintenance Window 25 June 2016

Started by gabba

5 Replies
6496 Views
Last post June 25, 2016, 12:02:03 PM
by gabba