VATUSA 24 hour time lapse (6/16/2017)

[Dhruv Kalra]

Posted: https://youtu.be/Pvm13uXHzRU

Your soundtrack is perfect .

[Brin Brody]

Doing one for the Anchorage FNO in August or should I?

[Matthew Kosmoski]

This may be a bit much to ask for, but would it be possible to get our hands on your scripts to generate these such that we, as the community, could generate them as we wanted?

[Daniel Hawton]

This may be a bit much to ask for, but would it be possible to get our hands on your scripts to generate these such that we, as the community, could generate them as we wanted?

All the data is obtained from my AirStats database, so you wouldn't be able to generate the same thing.

[Matthew Kosmoski]

This may be a bit much to ask for, but would it be possible to get our hands on your scripts to generate these such that we, as the community, could generate them as we wanted?

All the data is obtained from my AirStats database, so you wouldn't be able to generate the same thing.

Unfortunate.

So next question... expose the data via some kind of web services for our consumption? :-)

[Daniel Hawton]

This may be a bit much to ask for, but would it be possible to get our hands on your scripts to generate these such that we, as the community, could generate them as we wanted?

All the data is obtained from my AirStats database, so you wouldn't be able to generate the same thing.

That's a lot of bandwidth I don't want to pay for

Unfortunate.

So next question... expose the data via some kind of web services for our consumption? :-)

[Matthew Kosmoski]

This may be a bit much to ask for, but would it be possible to get our hands on your scripts to generate these such that we, as the community, could generate them as we wanted?

All the data is obtained from my AirStats database, so you wouldn't be able to generate the same thing.

That's a lot of bandwidth I don't want to pay for

Unfortunate.

So next question... expose the data via some kind of web services for our consumption? :-)

Given the absence of response, I'll let my imagination assume that it's an affirmative response

[Daniel Hawton]

This may be a bit much to ask for, but would it be possible to get our hands on your scripts to generate these such that we, as the community, could generate them as we wanted?

All the data is obtained from my AirStats database, so you wouldn't be able to generate the same thing.

That's a lot of bandwidth I don't want to pay for

Unfortunate.

So next question... expose the data via some kind of web services for our consumption? :-)

Given the absence of response, I'll let my imagination assume that it's an affirmative response

My response ended up inside the quote... that's a lot of bandwidth demands I don't wish to pay for.  That's the reason the API isn't public and won't be public.

[Matthew Kosmoski]

This may be a bit much to ask for, but would it be possible to get our hands on your scripts to generate these such that we, as the community, could generate them as we wanted?

All the data is obtained from my AirStats database, so you wouldn't be able to generate the same thing.

That's a lot of bandwidth I don't want to pay for

Unfortunate.

So next question... expose the data via some kind of web services for our consumption? :-)

Given the absence of response, I'll let my imagination assume that it's an affirmative response

My response ended up inside the quote... that's a lot of bandwidth demands I don't wish to pay for.  That's the reason the API isn't public and won't be public.

Are you accumulating the data simply by scraping the status output?

[Daniel Hawton]

This may be a bit much to ask for, but would it be possible to get our hands on your scripts to generate these such that we, as the community, could generate them as we wanted?

All the data is obtained from my AirStats database, so you wouldn't be able to generate the same thing.

That's a lot of bandwidth I don't want to pay for

Unfortunate.

So next question... expose the data via some kind of web services for our consumption? :-)

Given the absence of response, I'll let my imagination assume that it's an affirmative response

My response ended up inside the quote... that's a lot of bandwidth demands I don't wish to pay for.  That's the reason the API isn't public and won't be public.

Are you accumulating the data simply by scraping the status output?

Lots of math and frequent updates.  Since AirCharts serves a mirror of the data feeds, I get to process them more rapidly than the 2-4 minutes other sites are generally restricted to.  There are a number of calculations done and analysis before the position report is logged.

[Matthew Kosmoski]

This may be a bit much to ask for, but would it be possible to get our hands on your scripts to generate these such that we, as the community, could generate them as we wanted?

All the data is obtained from my AirStats database, so you wouldn't be able to generate the same thing.

That's a lot of bandwidth I don't want to pay for

Unfortunate.

So next question... expose the data via some kind of web services for our consumption? :-)

Given the absence of response, I'll let my imagination assume that it's an affirmative response

My response ended up inside the quote... that's a lot of bandwidth demands I don't wish to pay for.  That's the reason the API isn't public and won't be public.

Are you accumulating the data simply by scraping the status output?

Lots of math and frequent updates.  Since AirCharts serves a mirror of the data feeds, I get to process them more rapidly than the 2-4 minutes other sites are generally restricted to.  There are a number of calculations done and analysis before the position report is logged.

Other than offering services as another mirror, is there any way for the average Joe like myself to get higher fidelity data in the manner you do?

[Daniel Hawton]

Other than offering services as another mirror, is there any way for the average Joe like myself to get higher fidelity data in the manner you do?

No.  There are limits to how often you can pull from the mirrors and there isn't a perfect interval for when the data arrives at the mirror, either.  In fact, most mirrors monitor for abusers pulling more often than every 2-4 minutes and will block access.. so you can't just constantly call it to see if it's updated.  Truthfully, the data feeds weren't really designed to be used for a FlightAware-esque style capture.. as I was building my data capture scripts is when I realized the update interval didn't line up with the update interval specified in the data feed itself as each tweak and run of my script was generating different results within 2 minute spans.  Just happened to be one of the benefits having direct access to it.

[Matthew Kosmoski]

Other than offering services as another mirror, is there any way for the average Joe like myself to get higher fidelity data in the manner you do?

No.  There are limits to how often you can pull from the mirrors and there isn't a perfect interval for when the data arrives at the mirror, either.  In fact, most mirrors monitor for abusers pulling more often than every 2-4 minutes and will block access.. so you can't just constantly call it to see if it's updated.  Truthfully, the data feeds weren't really designed to be used for a FlightAware-esque style capture.. as I was building my data capture scripts is when I realized the update interval didn't line up with the update interval specified in the data feed itself as each tweak and run of my script was generating different results within 2 minute spans.  Just happened to be one of the benefits having direct access to it.

Interesting.  I suspected that the 2 minute interval wasn't accurate, but didn't want to piss anybody off looking in to it.

Is there any mechanism for individual users to get direct data feed access?  This is VATSIM, after all, it's not like we'd be looking at Terabytes of bandwidth a month on a status page.  I'd almost be willing to host another mirror if it could get me the data I wanted.

[Daniel Hawton]

Other than offering services as another mirror, is there any way for the average Joe like myself to get higher fidelity data in the manner you do?

No.  There are limits to how often you can pull from the mirrors and there isn't a perfect interval for when the data arrives at the mirror, either.  In fact, most mirrors monitor for abusers pulling more often than every 2-4 minutes and will block access.. so you can't just constantly call it to see if it's updated.  Truthfully, the data feeds weren't really designed to be used for a FlightAware-esque style capture.. as I was building my data capture scripts is when I realized the update interval didn't line up with the update interval specified in the data feed itself as each tweak and run of my script was generating different results within 2 minute spans.  Just happened to be one of the benefits having direct access to it.

Interesting.  I suspected that the 2 minute interval wasn't accurate, but didn't want to piss anybody off looking in to it.

Is there any mechanism for individual users to get direct data feed access?  This is VATSIM, after all, it's not like we'd be looking at Terabytes of bandwidth a month on a status page.  I'd almost be willing to host another mirror if it could get me the data I wanted.

Negative.  And there are some serious bandwidth draws.. in excess of 300GB per month from my mirror (and I pull from my feeds via the harddisk).  Running a mirror isn't a small thing, really.  In comparison, the VATUSA website pulls between 6 and 7GB per month and Aircharts pulls about 3 and 4GB.

[Matthew Kosmoski]

Other than offering services as another mirror, is there any way for the average Joe like myself to get higher fidelity data in the manner you do?

No.  There are limits to how often you can pull from the mirrors and there isn't a perfect interval for when the data arrives at the mirror, either.  In fact, most mirrors monitor for abusers pulling more often than every 2-4 minutes and will block access.. so you can't just constantly call it to see if it's updated.  Truthfully, the data feeds weren't really designed to be used for a FlightAware-esque style capture.. as I was building my data capture scripts is when I realized the update interval didn't line up with the update interval specified in the data feed itself as each tweak and run of my script was generating different results within 2 minute spans.  Just happened to be one of the benefits having direct access to it.

Interesting.  I suspected that the 2 minute interval wasn't accurate, but didn't want to piss anybody off looking in to it.

Is there any mechanism for individual users to get direct data feed access?  This is VATSIM, after all, it's not like we'd be looking at Terabytes of bandwidth a month on a status page.  I'd almost be willing to host another mirror if it could get me the data I wanted.

Negative.  And there are some serious bandwidth draws.. in excess of 300GB per month from my mirror (and I pull from my feeds via the harddisk).  Running a mirror isn't a small thing, really.  In comparison, the VATUSA website pulls between 6 and 7GB per month and Aircharts pulls about 3 and 4GB.

Matter of perspective, I suppose.  300GB/mo is small potatoes these days.