VATUSA Forums

General => The Control Room Floor => Topic started by: Kyle Sanders on July 06, 2021, 11:17:11 AM

Title: Pilot Expectations, cont...
Post by: Kyle Sanders on July 06, 2021, 11:17:11 AM
I am creating this thread because as Mani (USA1) stated in another topic thread, he does not wish to shut down this discussion, but it was a bit outside the scope of the topic it was posted under.
Reference: https://forums.vatusa.net/index.php?topic=10178.msg45876#msg45876




The following is the partial post from Dylan Lundberg on 05JUL2021 that triggered a following of those that agree that VATUSA Management should be advocating to VATSIM HQ for more accountability and reasonable knowledge checks for pilots prior to pilots being allowed to connect and fly.

Quote
2) What is the UNDERLYING cause of controllers not wanting to control? P I L O T S. I'll be damned if I'm going to staff more than I'm required, when us controllers are held to a crazy high standard, yet the 13 year old that gets MFSF2020 can connect without actually being checked for competency to comply with basic ATC instructions. Obviously this issue goes higher than VATUSA, but VATUSA isn't doing anyone any favors by telling facilities towards the bottom of the list "You should be online more." What VATUSA COULD be doing to help improve and motivate controllers to do more than what it required, is to be up at the front door of the BOG, knocking until they actually start taking pilot competency seriously. IT IS NOT FUN when we get online, and have to hand hold 50% of the pilots on our frequency. That alone is a big reason why most facilities don't have an higher uptime. Then you need to account for environmental factors like, I don't know, actually having a life outside the hobby, LOAs, etc. Controllers are BURNTOUT from dealing with the pilots that do not know what they're doing. We can preach to them that they should read the Pilot Learning documents, but currently that is merely a recommendation.

3) Last year (IIRC), VATUSA was more worried about having exit interviews with S1s (who cares?) when we should have been focusing on our C1+'s that got fully certified, worked some hours, and went away. Who cares why the S1 who did minimal training to work a DEL/GND position left? You'd have much more meaningful feedback if we focused on the fully certified C1+s that left after certification. If we did that, I'm willing to bet that you'd be hearing the same thing about pilots over, and over, and over again...if you had that feedback last year, maybe we could have made meaningful impact network wide regarding pilot competency, and eliminating that as a factor for Burnout.

4) You don't motivate leaders/members of a volunteer organization by comparing them to the guy next door. You're treating this as a company-type measurable metric, as if the pilots are our customers. No. Don't. PLEASE DON'T. By reaching out to some ARTCC leaders and telling them "We think your facility should be on more" again, is ignoring the underlying issues at hand. We need to first address the WHY, fix those issues, THEN we can begin to make headway in uptime.

My personal note:

I am a huge advocate for constructive feedback for management. Compared to years past, this particular group of individuals at the VATUSA HQ seem to be much more concerned with getting things done that have needed to be done for years and for the most part, approach these projects and tasks with a sense of logic and reason.

I would very much like this discussion to not be so much of a pilot and management-bashing thread but rather a constructive means to relay to our HQ department the reasons we are tired of controlling on the network with pilots that directly kill the “Realism” and therefore, “fun” of the simulation for us.

Yes, pilots have choices for the networks they can join (if any) to fly their sims and an argument could be made that ATC need Pilots, but not the other way around... sure, but if your activity hours for ATC start to dwindle, along with the quality in which we provide services, then that is an issue too. We might have found another hobby that doesn't annoy us so much. I am in favor of making this network just as attractive for ATC as it is for pilots.

For every pilot that is “one of those”, it seems that there is another pilot that takes the constructive criticism and resources we send via PM very well and appreciates the time we took to give them this information.

Why isn't this information provided to them in a more constructive way from the beginning? Even though I like the pilots that take the information well, it still takes away from me separating traffic and doing my job, and ultimately takes away from the simulation.

The Pilot Learning Center is fairly well done, but it does not seem to filter out “THOSE” pilots that have no intentions on making this a fun and educational environment, and it seems that the pilots that would benefit from that information and appreciate it still don't know it's there until we take the time to PM them.

Can we start the discussion on what can be done at the VATSIM level to correct this and hopefully propose it to the higher-ups?
Title: Re: Pilot Expectations, cont...
Post by: Alex Ying on July 06, 2021, 12:35:29 PM
I'll preface this by saying 75+% (perhaps even more) of pilots I see on the network while controlling are great. They know their stuff, or if they run into something where they don't, they know where to find information or how to ask for help and are receptive to feedback.

However, those that don't fall into that category can be so distracting that it completely outweighs the positive enjoyment I get. There's been some research on things like this and on average, people perceive bad experiences about 3-4 times worse than equivalent good experiences. It only takes one bad pilot to completely ruin a controlling session because we're in the unfortunate circumstance where a competent pilot is almost unnoticeable compared to a bad pilot who can't turn the right direction, or hold a heading, or even give readbacks. Our bad experiences, even before accounting for perception, are worse than good experiences.

In the past week in about 6 hours of online time, I've seen instances of

These are just the occurrences that stand out because they were more obnoxious than usual. On top of that, there's the tons of unresponsive or AFK pilots, and the usual lack of chart-reading or improper FMS programming or not knowing how to hand-fly a departure procedure. We've collectively just come to accept these, but why? All of the lack of pilot competencies increases controller workload. I regularly have to message neighboring controllers asking if they got a pilot on comms because they don't even reliably read back comms transfers.

Until there is a robust means of enforcing stuff that's already in the CoC (B8 for example), I'm not convinced a change in the CoC or other network rules will be effective. What happens after I wallop someone? Usually a SUP contacts me and says they're on it and after some time the pilot either calls me or gets disconnected. If they get disconnected, then is there a follow-up action? I would hope so, but as a regular member of the network, I have no visibility into that, and I don't have way to know that action is in fact being taken. Suppose they do call me, this is actually sometimes more of a problem because more likely than not, the reason I had to call a SUP to begin with was because they don't know what they're doing. I may now have someone who I have to hand-hold, or someone who is barely responsive, or in the worst case, someone who is actively causing problems on my frequency (stuck mic, or has bad radio etiquette, or is actively hostile towards me).

I'm sure I don't have the best solutions to these problems, but from the perspective of a regular controlling member, it doesn't look like management/governance at the VATSIM level really cares about the controller perspective. Every time I've seen a forum thread on this (usually on the VATSIM forums), discussion about stricter enforcement of rules gets shut down or brushed aside. I think stricter enforcement of the rules we currently have would go a long way to making things better. Give controllers the confidence that when they do report something, that something longer-term than just kicking the pilot off the network is being done.

Controllers tend to be the most skilled and highly trained people on the network simply because we have to go through all this training. Empower us and put more trust in us to do the right thing. I shouldn't have to send 3+ messages to a SUP describing in depth what the problem is to get a problematic pilot kicked (this is rare, but if it does happen, and I'm very busy I often can be covering en-route top-down, it's very annoying). Give us a way to report pilot deviations that don't require calling a SUP in. While annoying, I can work around someone who lands on the wrong runway or doesn't join the localizer. I don't want to go through the wallop rigmarole nor do I want to waste SUPs' time with things that are smaller infractions but infractions nonetheless. (As an aside, why is it that when I connect with the wrong vis range, I almost instantly get a message from a SUP, but it can take 5-10+ minutes to get a problematic pilot removed? Is this an automation issue? If so, all the more reason to empower controllers. Let us help the supervisors.)

Having a pilot record would also, in my opinion, go a long way towards creating stronger incentives for pilots to actually read and learn the material in the pilot resource and learning centers. Right now, once you pass the entrance exam, you can get away with learning nothing else and if you don't care, all the encouragement and asking nicely from other people isn't going to do anything (leading a horse to water vs. getting it to drink and all that).
Title: Re: Pilot Expectations, cont...
Post by: Zachary Bartig on July 06, 2021, 12:36:05 PM
Hi All,

Hope everyone had a great 4th of July weekend.  I've been reading through the mid-year thread for a while now and am glad to see that the discussion of pilot quality is becoming more widespread. Based on some things that I have read above I figured I'd chime in quick on the topic through a non-controller perspective.

Since the origination of MSFS integrating with the network, I've noticed (and believe many others have too) the mass influx of these new members jumping straight into their Neos and 747s, as when those new to aviation think about aviation, airliners are generally what comes to mind first rather than the basics such as 172s and the like.  Now, of course the network is based upon having the freedom to fly whatever, and wherever, but I do believe that the majority of the new members on the network are really missing out on some of the finer things that aviation has to offer, and even the basis of MSFS itself: VFR flying. 

I know that there is a growing increase in members discussing the need for more introduction training/CBT for new pilots on the network, but training systems also take thousands of man-hours to create and sustain; something that may be part of the hinderance to jump to that ship.  In my eyes, I wanted to suggest looking at some of the community generated assets that may be little-known, but are extremely beneficial to the pilot-training portion of the network.  What really stands out to me, is the Virtual USA Flying Club.  No, this is not some shameless plug, just a community asset that I've come to really hold at a high standard on Vatsim, and admire the hard work that the VUFC community puts in to being personable with new members on the network. 

I joined the VUFC about a year or so ago, and attend most of their fly-in events.  Surely it is a ton of fun, but to me, the golden ticket there are the community members that it is comprised of.  Over time, I see dozens and dozens of pilots new to the network that join, but often with many questions even as simple as how to fly a pattern.  There has not been a single question there that has not been answered by a handful of people, often even offering to jump into a voice channel and work one on one with them.  My basis for that is, I see Vatsim and/or VATUSA trying to partner with larger streamers to bring in new people, but once these newcomers join, it just adds to the growing group of those who may be a bit lost, or jump straight into the airliners.  Possibly discussing a partnership with a group such as the VUFC as an option for newcomers to join, not only would help alleviate frustration that newcomers may have, but also will teach the very fundamentals of aviation (VFR) that in my eyes would be asinine for someone to not understand prior to hopping into an IFR scenario. 

Building upon that in terms of partnerships (and streamers), the new stream partnership announcement I think is pretty cool, but I took it with a grain of salt as well.  To me, and I know to some others as well, a lot of these streamers inadvertently draw in a large part of the crowd that wants to jump straight into airliners and complex aircraft.  Theoretically, this is because they see the guy on stream can fly the A320, so why can't they jump in and do the same?  Flying of course is a lot more than just following the checklists or steps from the streamer.   Communication and processes are a huge part, which often is overlooked and to me is a large part of the frustration that controllers are facing. 

In terms of business and marketing, I get it.  Partnering with well known large streamers is a huge key to growing brand awareness.  I mean, Microsoft parters with some of the world's largest marketing firms, not the guy on Fiverr, right?  But I also think that it is effective only to a certain point.  Going back to the above in regards to the VUFC, there are a few key streamers in there that work most specifically on VFR flights, simple IFR, and how-to/instructional videos as well, for example Eric (EricFlight), Rob (Slant Alpha Adventures), Mike (Jet Pilot Cinnamon), and the list goes on.  They may not have the largest following, but I think it would be absolutely more than beneficial to work with some of the dedicated individuals such as the ones listed above if we are talking stream partnerships.  It's a quality over quantity scenario for me, and I think that may be the missed point here.  Having partnerships with personable streamers that interact with everyone in the chat log to promote the learnings and fundamentals of aviation to me would be a no brainer, especially considering that many of them are a lot more dedicated to Vatsim itself than the ones who get on Twitch and make $5K per video.  Kudos to them for creating that type of income stream, but considering that Vatsim is a non-profit organization, wouldn't we want to be partnering with those who dedicate their time to volunteering and helping others on the network rather than creating money incentivized Twitch moguls?  And I don't want to get off on the wrong foot there, as I have tons of respect for those who can create such large followings online and I am more than sure that they are all great quality people.  But at the same time, I think it would be a bit more logical to look into those who have been with Vatsim for years, dedicated to furthering Vatsim and the knowledge of new-school AND old-school pilots on the network. In my eyes, giving back to those who have been here through the thick and thin by supporting their channels (which have supported Vatsim for years) is not only just a moral thing, but it's also just a clear and simple way to help alleviate the pilot issues.

I don't mean to go on and on and on here, but there does become a point in which people start to notice that the efforts from above are shifting more to growing a brand instead of working to patch up some rough areas.  We can't build a 10 story building when the 1st floor has weakened supports. 

TLDR, the pilot quality issue is getting worse.  There is no way to disregard that; but IMO Vatsim is continuing to follow the wrong route by promoting large streamers to bring more new pilots to the network.  This only adds to the group of people that hop straight into complex IFR and airliner scenarios that are way above their head, completely skipping right over all of the fundamentals of flying (VFR, training, common procedures, radio communication, etc.).  We have resources that are already built for this (such as the VUFC, and smaller but more dedicated streamers), but they are overlooked each day as eyes gaze upon the member count number and mouths drool over making it increase.  Lately Vatsim just seems to have lost it's personal "zest" that it held for well over a decade, and has become more of a hostile corporate-feeling community rather than the personalized buddy network that it was.

I must note, I don't mean to take a dig at anyone, or anything.   I am more than grateful for what Vatsim and the community has to offer for everyone and myself, but I just can't help but notice that it seems to be taking the wrong turn towards rapid expansion rather than addressing pilot quality. By recognizing the tools out there in the community we could more than help the alleviation of such issues. Just my thought processes. Hopefully this reaches some fruition at the higher levels.

Best regards,
Zach
Title: Re: Pilot Expectations, cont...
Post by: jeff pace on July 06, 2021, 01:09:10 PM
Hello All,
I am pasting my response to the other thread here as this thread is covering pilot competency issues. I am getting frustrated seeing the pilot quality getting worse all the time. I think some very good points have been brought up in this thread. If I may, I would like to give some thoughts from a pilot's perspective.  Sorry for the long drawn out response in advance. I'll admit I am not the most amazing Vatsim pilot out there and only have 150+ hours on the network but I do have 1000s of hours flight simming (mostly xplane11 and a couple hundred on MSFS2020). I agree with alot of what the controllers are saying in this thread.

First, I feel like the addition of MSFS2020 to the network is a big issue. That "sim" is where alot of issues lie right off the bat. I feel like MSFS2020 is an amazing sim for VFR flying only and theoretically it could be on the network in VFR conditions for VFR flying. The real issue is IFR. I have tried the airliners (747,787, A320Neo and FBW A320) and jets in msfs2020 and they are nowhere near being ready for Vatsim (hence why I fly them offline until they are good enough to be flown on the network which will be later). I cannot speak as far as the popular CRJ7 and the other CRJ's that Aerosoft has produced however. The systems are not to where they should be in order to fly on the network. Speaking of aircraft on the network, I do alot of flights in a new aircraft off of the network before I even consider jumping on the network and flying it on the network like at least 5-10 hours of flying off the network before doing it on the network and making sure I am 100 competent in that airplane first. Alot of people seem to get a new airplane regardless of what sim they are on and jump straight on the network, which is the wrong thing to do which is where alot of issues come into play.

My second point will be about the incompetency of the pilots. The fact that pilots in MSFS2020 and even some in other sims don't even know what a chart is disconcerting. The pilots don't even know about such things as skyvector. I bring up Skyvector as a perfect example. Why? Because its free. When I started getting into IFR flying about a year ago, Skyvector was my go to tool before I upgraded my Navigraph subscription and as I fly real world I also have a foreflight subscription as well. I learned how to read the charts, I learned about spd/alt constraints, the differences of what different airplanes can or cant do. For example, /L vs /W vs /A etc. I learned the lingo of ATC and what to expect and what to have pre-planned for my flight (example, what is D-Atis saying regarding runways and taxi ways), what is the metar and current weather conditions and the airport im departing and what can I expect weather wise and runway wise at my destination? The fact that pilots are not doing the research and not having the knowledge is the issue even when the info is free and readily available even on the internet or on the particular VATUSA pages for those specific airspaces.

I feel really bad for controllers when they have to deal with incompetent pilots. I as a pilot even get annoyed with this issue. There's alot of great younger pilots but the immaturity of some of these pilots is an issue as well regardless of age. I feel as if with the addition of MSFS2020 there are alot more immature teenagers and frankly kids on the network. There are alot more trolls on the network as well who want to have fun and fool around even on the frequencies which is frustrating especially if say you are on an arrival or approach, etc. As a hardcore simmer, I feel like trolling is a big issue right now. Evryone wants to fool around and BS with their friends and so on and so forth. For example, I was taking off at ATL going to KSDF the other day. A youtuber and his following decided to spawn in at KATL (no big deal). This youtuber it appears has alot of younger pilots that follow him, specifically of the teenage age group. Like I said I have no problem with ages whatsoever. KATL and KZTL controllers were amazing and did a great job, however the other pilots were causing havoc. They were stepping all over each other on the ground frequency, not letting the controller do his job, chit-chatting on the frequency, and more. I think I sat there for approximately 30-45 min to taxi to the runway. (I wasn't even mad and was greatly impressed with this ground controller's skills).

Yet it seems vatsim gets on the controller's instead of getting on the real issue, incompetent pilots. I can totally see why the controllers get frustrated and burnt out. I feel like they get talked to or perhaps in trouble for something that's completely not their fault. It is the pilots responsibility to be able to fly their aircraft without the handholding of the controllers. Aviate, Navigate, Communicate (the responsibilities of the pilot). And if feel as if ATC is having to handhold one pilots hand or focus on them bc that pilot is competent or doing whatever they want to do and not listening to ATC, it takes attention away from their controlled airspace, etc, which can also make the pilots feel as if their service is degraded which isn't fair to those other pilots or the controllers. I think we have alot of amazing controllers on this network and I don't think its fair to them.

From the bottom of my heart, I want to thank all of you Vatsim staff, VATUSA staff, Controllers of all levels, from C/D all the way up to center controllers. You all do an amazing job on this network, and us pilots appreciate you all! You all are the real heroes of this network and I genuinely appreciate the dedication and the time you guys put in to control us pilots. You all are amazing. Keep your head up and keep up that amazing great work that you all do! THANKYOU all so very much

Like I said, I apologize for the long post. Thankyou all for your time. Mods feel free to take this down or edit if something I said is not allowed.
Title: Re: Pilot Expectations, cont...
Post by: Robert Shearman Jr on July 06, 2021, 02:16:16 PM
Zach, I  appreciate the kind words and the mention.  I do think that as a network, VATSIM can do more to point pilots to resources to learn and get started.  And I do think there needs to be some accountability when they refuse to do so.

However, as much of a proponent of General Aviation flying I am, I don't think *forcing* pilots to start with GA is the right move.  The overwhelming majority of VATSIM pilots want to fly airliners because that is what they consider fun and that is what interests them.  Forcing them to first do X-dozen hours of something that they *don't* consider fun and that *doesn't* interest them is not the right way to go.  It's only going to chase them away.

There are thousands upon thousands of perfectly capable virtual airliner pilots on the network on a weekly basis, and many of them have 0.0 hours in anything smaller than 100,000 pounds.   Let's figure out how they got there and encourage the rest of our budding Captains to follow a similar path.   The ones who want to gravitate toward General Aviation will do so, and I think we've proven that we can make that experience super-enjoyable when they do.  But let's not force the ones who don't.
Title: Re: Pilot Expectations, cont...
Post by: Tim Simpson on July 06, 2021, 02:20:50 PM

Until there is a robust means of enforcing stuff that's already in the CoC (B8 for example), I'm not convinced a change in the CoC or other network rules will be effective. What happens after I wallop someone? Usually a SUP contacts me and says they're on it and after some time the pilot either calls me or gets disconnected.

Maybe that's a start.  The reality is that these forums are more closely moderated than the online network.  Think about that.  Instead of a wallop, followed by a lengthy discussion, why not give all controllers moderator power?  WARNING!  Upcoming POSCON reference.  Allow the controller(acting as a moderator) to "ghost" the offending pilot, and have the ghosting action trigger a direct audio connection between the offending pilot, and a randomly assigned online supervisor.

Title: Re: Pilot Expectations, cont...
Post by: Robert Shearman Jr on July 06, 2021, 02:29:32 PM
I definitely think POSCON is on to something when they (a) are building an infrastructure which allows pilots to receive positive or negative feedback just like controllers do, and (b) empower controllers to take immediate action when pilots are disrupting the frequency and/or the flow.

Making those actions subject to review, and to discipline controllers who abuse them -- and making the note that the pilot receives when it happens constructive, encouraging them to fix the issue and try again next time -- those are the challenges.  And they're big ones, which is probably why VATSIM leadership has balked at moving in that kind of direction.
Title: Re: Pilot Expectations, cont...
Post by: Justin Blakey on July 06, 2021, 05:39:45 PM
I've also been extremely annoyed by the pilot quality issues as of late. I'm not going to write a book here as many of my thoughts were already said by those above and in the other thread that this one stems from, but here are some of my thoughts on possible steps in the right direction on this issue.

1. More advanced entry exams. I am aware that VATSIM now requires an exam for new pilots, but I haven't seen its contents (is this possible?) and I know for sure it hasn't made a dent in the problem. An idea could be to make a new exam on the basics of IFR (targeted at the 13 year olds who want to go from zero to 747-8), covering things like SIDs, STARs, arrival transitions, approaches, top altitudes, chart reading, etc. and prohibit new pilots from filing IFR flight plans until they pass the exam.
2. A better enforcement system. Along the lines of what Alex said, empower the controllers. Create a system for us to file "deviations" against pilots for common mistakes and save these to the pilot's record. I'm not saying that these should be vehemently enforced/punished (in most cases a simple follow-up explaining the mistake and what to do next time would probably suffice), but if a pilot has had 10 deviations filed against them in their last 10 flights then action should be taken.
3. Pilot rating programs. I promise I'm not trying to pat ZBW on the back here, but PRPs can provide a great introduction to the ATC/communications/procedural side of flying that are not easily replicated. I have a unique perspective as I went through BVA's WINGS program at the same time as my IRL instrument ground school, and I can definitively say that the WINGS briefings explained many instrument concepts better than my ground school did. I'm not sure if there is a good implementation or realization of this, but PRPs are (in my view) a great way to improve pilot quality as they require pilots to actually learn something and involve feedback from controllers.

Controllers have mandatory training requirements; pilots do not. Feedback/QA systems for controllers are in place at most facilities, but there is no equivalent for pilots. It's time to fix that.
Title: Re: Pilot Expectations, cont...
Post by: Tim Simpson on July 06, 2021, 05:43:01 PM

However, as much of a proponent of General Aviation flying I am, I don't think *forcing* pilots to start with GA is the right move.  The overwhelming majority of VATSIM pilots want to fly airliners because that is what they consider fun and that is what interests them.  Forcing them to first do X-dozen hours of something that they *don't* consider fun and that *doesn't* interest them is not the right way to go.  It's only going to chase them away.

I respect that opinion.  There might be some who would balk at the notion of having to learn the ropes through general aviation.  I do think you are looking at this though, as if VATSIM exists in a vacuum.  I don't want to dredge up the whole game vs sim argument, but flight simming and VATSIM are computer games.  Gamers in general are used to having to start at level one, and then advance, to gain more things in a game.  Many virtual airlines start "new hires" in turboprops, or regional jets until they build hours, and then get promoted, allowing them to fly larger aircraft.  Lastly, I'll give the example of iRacing.  You have to start at the bottom in iRacing, and show competence before you can move up in their divisions.  Yes iRacing is a paid service, but you can't just bull rush your way in, and say your gonna start out in the top tier stock car division on day one, yet iRacing thrives on that model.  Virtual airlines that require time building thrive.  First person shooters and RPG's thrive on the level up concept.  VATSIM could thrive as well...........if it wanted to.  Opinion as well.
Title: Re: Pilot Expectations, cont...
Post by: Andrew Lorenzo on July 06, 2021, 06:32:25 PM
Do something like Uber. Pilots can send feedback to controllers(which is already a thing), and controllers can leave feedback on a pilot. Hopefully, pilots will take it as constructive criticism.
Title: Re: Pilot Expectations, cont...
Post by: Nicholas Watkins on July 06, 2021, 06:34:12 PM
Do something like Uber. Pilots can send feedback to controllers(which is already a thing), and controllers can leave feedback on a pilot. Hopefully, pilots will take it as constructive criticism.

YES! Ebay or Uber like feedback. Points given or taken away by a mostly automated system that would have input components to it on the part of ATC or the Pilot. In a very basic analogy think Ebay feedback.  I leave the seller feedback as the buyer and the seller leaves me feedback.

Also, the Pilots leaving Controller feedback isn't centralized currently and the pilots have no way of knowing a controller feedback rating.  Most, if not all, ARTCCs/FIRs don't even display a feedback metric on their website by controller.
Title: Re: Pilot Expectations, cont...
Post by: Zhenhao Yang on July 06, 2021, 06:34:50 PM
I definitely think POSCON is on to something when they (a) are building an infrastructure which allows pilots to receive positive or negative feedback just like controllers do, and (b) empower controllers to take immediate action when pilots are disrupting the frequency and/or the flow.

Making those actions subject to review, and to discipline controllers who abuse them -- and making the note that the pilot receives when it happens constructive, encouraging them to fix the issue and try again next time -- those are the challenges.  And they're big ones, which is probably why VATSIM leadership has balked at moving in that kind of direction.

Perhaps VATUSA or VATSIM HQ can build something similar to the real-world NASA Aviation Safety Reporting System, in which:
As a long-term goal, statistics of the most common deviations at each facility can also be published, and facilities can address these specific issues.
Title: Re: Pilot Expectations, cont...
Post by: Ryan Pitt on July 06, 2021, 06:42:46 PM
I definitely think POSCON is on to something when they (a) are building an infrastructure which allows pilots to receive positive or negative feedback just like controllers do, and (b) empower controllers to take immediate action when pilots are disrupting the frequency and/or the flow.

Making those actions subject to review, and to discipline controllers who abuse them -- and making the note that the pilot receives when it happens constructive, encouraging them to fix the issue and try again next time -- those are the challenges.  And they're big ones, which is probably why VATSIM leadership has balked at moving in that kind of direction.

Perhaps VATUSA or VATSIM HQ can build something similar to the real-world NASA Aviation Safety Reporting System, in which:
  • Any participating member (pilot, controller, observer) can submit a report.
  • Incident reports are made public but personal identifying information (PII) is redacted.
  • Constructive feedback is provided to the offending pilot so they can become aware of their mistakes, when often times there is not enough time for the controller to explain everything in the moment online.
  • Self-reporting grants the offending pilot immunity (at least for the first violation) from certain CoC/CoR enforcement actions.
As a long-term goal, statistics of the most common deviations at each facility can also be published, and facilities can address these specific issues.

Some facilities do have something internally like this. I do think we need to start moving towards giving pilot feedback as well. Shouldn't be too hard at the VATSIM level to get the ball rolling.
Title: Re: Pilot Expectations, cont...
Post by: Kaylan Fullerton on July 06, 2021, 07:01:54 PM
I agree with pretty much all points on this subject. Everything from this point forward is in my opinion. Bottom Line: Pilot proficiency is lacking and should be significantly improved. Pretty simple (but may take a lot of work) solution to said problem: Like controllers, pilots need to be trained and certified (either via self-study, face-to-face), prior to being turned loose. Anything short of this will yield the same results we've seen for years. However, like Robert said, there are plenty of pilots who are capable of doing their own self study to make themselves proficient enough to fly so restricting every pilot on the network is not necessary and will probably cause more headache.

Problem: By design, there are significantly more pilots than controllers so training such a volume face-to-face like we do controllers probably just isn't feasible.

Possible Solutions:
- Pilot Deviation Reporting - No brainier and everyone above has indicated exactly how I'd go about it. Pilots need to be able to see it so they can learn and grow. Should be managed by the Facility with the ability to be elevated higher if further action needs to be taken.
- Pilot Rating System similar to Pilotege - Their system works. What I like most about their system is you don't have to use it, but you better be good. If you are not good, use this program to get good. Oh by the way, no exam, just get on the network fly and prove that you can perform with a entire network of people around basically 24/7 to help you understand complex concepts/material.
- Controller kill Pilot capability - Remove the problem child when they are a problem (even if not on purpose) and file the report. Maybe they didn't know, but now they do and everyone can learn and grow. The reality is SUP's (to no fault of their own) are poorly equipped to actually decide if a pilot is worthy of a kill as it relates directly to air traffic operations in a "timely" and fair manner. The best equipped people to decide that is the facility. Guy who's frame rates aren't cooperating, kill. Guy who spawns on runway, kill. Guy who leaves computer 20 miles from the field on final freq, kill. File the report. They learn, your scope is manageable again, everybody happy. I imagine the process of the ".kill" is probably more complex, but you get the idea.

There is a certification and operation for those who choose that they in fact do not want to do the work either on their own or via a program to get smarter and more proficient. It's called the PPL and Visual flight rules. I have never complained with seeing a group flight of 30 aircraft in my airspace doing flips, tricks, and whatever else they do on unicom in uncontrolled airspace. The guy that doesn't want to do the work can still fly from ATL to SEA... just below FL180 and with basic radar services. Everyone still gets to play.

I realize that in practice, this is a gross oversimplification of what would be required to establish such a system and VATSIM/VATUSA has come such an incredibly long way over the last year. Most of what needs to be said has already been said and I ultimately want to provide my +1 for this issue.

V/R

Kaylan
Title: Re: Pilot Expectations, cont...
Post by: Kyle Sanders on July 06, 2021, 07:38:25 PM

ATSAP for controllers. I like this.
https://www.atsapsafety.org/login/pages/documents/what-to-expect.xhtml
Title: Re: Pilot Expectations, cont...
Post by: Manuel Manigault on July 06, 2021, 08:56:10 PM
Kyle, thank you for splitting the conversation.  Feedback and ideas in this conversation won't go to waste.
Title: Re: Pilot Expectations, cont...
Post by: Douglas Peterson on July 06, 2021, 08:57:44 PM

(As an aside, why is it that when I connect with the wrong vis range, I almost instantly get a message from a SUP, but it can take 5-10+ minutes to get a problematic pilot removed? Is this an automation issue? If so, all the more reason to empower controllers. Let us help the supervisors.)

TBH, the vis range enforcers make controlling demoralizing. I recall doing an event where I was doing Local instead of my usual approach position. I didn’t downgrade my vis range, and was pretty busy. Some SUP had nothing more important to do besides send me messages about my vis range. Meanwhile any OBS or any pilot could connect with 4 times my vis range and be just fine. This made sense, maybe, back 15 years ago. But now? It might be nice to not gratuitously piss off your controllers, especially the instructors. Just saying
Title: Re: Pilot Expectations, cont...
Post by: Zachary Bartig on July 06, 2021, 11:20:20 PM
Zach, I  appreciate the kind words and the mention.  I do think that as a network, VATSIM can do more to point pilots to resources to learn and get started.  And I do think there needs to be some accountability when they refuse to do so.

However, as much of a proponent of General Aviation flying I am, I don't think *forcing* pilots to start with GA is the right move.  The overwhelming majority of VATSIM pilots want to fly airliners because that is what they consider fun and that is what interests them.  Forcing them to first do X-dozen hours of something that they *don't* consider fun and that *doesn't* interest them is not the right way to go.  It's only going to chase them away.

There are thousands upon thousands of perfectly capable virtual airliner pilots on the network on a weekly basis, and many of them have 0.0 hours in anything smaller than 100,000 pounds.   Let's figure out how they got there and encourage the rest of our budding Captains to follow a similar path.   The ones who want to gravitate toward General Aviation will do so, and I think we've proven that we can make that experience super-enjoyable when they do.  But let's not force the ones who don't.

Rob,

My apologies, I think I may have worded the above a bit misleading. My point was to highlight that we have many resources available such as the VUFC, and streams such as yours, that are either entirely dedicated, or partially dedicated to the promotion of VFR flying and the basic foundations of aviation.  As always, I more than value your opinion here and I do agree with you.  It wouldn't be logical to force new pilots to fly VFR or smaller aircraft for "X" amount of hours.  However, I do think that encouraging those new pilots to do so could be a good helping hand in fixing part of the quality issues. 

Since my last post, I had thought of a way to easily put something like that into fruition.  When a new pilot signs up for a membership on the network, does the CBT, etc. and is finally set free, perhaps an email and/or pop-up screen highlighting some of the network's assets wouldn't hurt.  Among those in this "list", could be categorization of which assets offer what.  For example, a category of clubs/groups such as the VUFC that offer introductory style VFR events and some complex ones as well, plus a million helping hands within the community.  Along with that could be categories of streamers;  Training/instructional/VFR streamers such as Eric, VFR event and processes streamers such as Mike, Navigational and technique-based flying streamers such as yourself, and of course the inclusion of some of the larger streamers who stream mostly IFR/airliners/more complex flights.  (**note, as far as the examples above go, they are simply just some of the best quality that I have seen, and I of course cannot speak on their behalf)

By having categorized resources like the above, and promptly advertising them through at least 2 direct routes, the awareness of those resources' existence in my opinion surely would have us all on the right steps towards fixing quality issues, and to help those who may be a bit lost.  It goes without saying that there are definitely some trolls that peruse the network, but I think a majority of the pilot quality issues are simply due to honest confusion.  By choosing to include resources such as these, we not only give back to those who put blood sweat and tears into supporting Vatsim, but also remove the line of confusion between new pilots, and the quality information/material that can help them prosper within the network. 

Above all, the suggestions on this thread are all incredible, but I do really like the idea of having a pilot feedback system, especially one along the lines of the NASA system that Zhenhao suggested.  With ARTCC/sector-based data logging of common mistakes, VATUSA and it's divisions can use this information to find remedies to common issues such as the infamous ORCKA departure turn out of LAX.  With publicly available incident reports (but no PI revealed), those whom may wish to take the responsible course of action prior to flying into a new airport could now have a valuable resource that can highlight the common mistakes and misconceptions of the procedures associated with a particular airport.

Cheers,
Zach
Title: Re: Pilot Expectations, cont...
Post by: Daniel Kormendy on July 07, 2021, 12:26:13 AM
Hey everyone,

I wanted to just overall share my experience and idea on the pilots that I experience daily. I am a controller from VATCAR and I control the ZSU (San Juan CERAP) in Puerto Rico, outside of VATCAR I control the ZLC ARTCC with Kyle as well so we have both works with each other quite a bit. I'm very happy that this issue is attempting to be addressed to VATSIM managers/governors as this has been an issue even starting as a basic S1. The first time I dealt with inexperienced pilots was at Jacksonville, I had never encountered a pilot who had no real flight experience because I had been so used to just decent pilots at the time. I was originally an S2 at Jacksonville and I couldn't handle why this guy didn't know what an IFR clearance was or anything, he didn't know he needed some sort of allowance to fly via an IFR clearance. I was very frustrated when I got bad feedback for attempting to help him by providing constructive feedback to get better, it took me about a month to get back to controlling after that situation. The core values of VATSIM are "Aviate, Educate, Communicate" something like that. The problem with pilots is that VATSIM provides the "educate" part in there but really doesn't do much to maintain that "educate" part for pilots. VATSIM should implement a system like said by Kaylan Fullerton a feedback system much like ours. This would help benefit pilots by providing constructive criticism to improve as pilots and also give them a chance to fix their mistakes the next time they fly. Let me list some things I have seen so far for the past few weeks.

*  Pilot fails to contact me in a timely manner.
* Pilot has a language barrier and is unable to contact me in English when the language of the air is English.
* Pilot fails to turn in a timely manner after requested to turn by a controller.
* Pilot fails to understand what "Hold for Release" means
* Pilot doesn't understand that PDC commands via PMs are NOT CPDLC systems and attempts to contact me via telex and uplink messages.

These are just some of the things that I see on a daily basis, some may be strange things that you don't see on a daily basis however some mistakes can be simply just failing to maintain a simple, heading, or altitude. Another situation I had was actually Gander and if you are certified in an oceanic position you would totally understand how I feel about this. Pilots do not know how to really cross the pond properly all the time and they can miss key information that you need for an oceanic clearance or just go AFK and not contact you because the flight is long. Gander has been one of the most frustrating positions to work in only because the pilots who decide to cross the pond poorly understand how oceanic control works. Pilots will call me from La Guardia for a taxi for a VFR departure to the west out of the New York class bravo or I will get a pilot calling me for oceanic clearance from the other side of the pond. At a certain point I got stir crazy from just the boredom and fury I experience trying to focus on like 10-20 planes at once during events and contacted by everyone who is not supposed to contact me or I am not getting concise information. I ended up just quitting Gander because of that specific reason. I hope my feedback or stories helps provide an inside into the things along with many other C1+ rated controllers experience when controlling a center or flight service station position.

Thanks,
Daniel Kormendy
Title: Re: Pilot Expectations, cont...
Post by: Brad Littlejohn on July 07, 2021, 06:06:31 PM

Wow.. and with no hint of sarcasm or cynicism, I have to say that here we go again with this thread. Not that it is tedious or to gather a ton of groans, but that if it is being brought up again, it is important and something needs to be done. What that something is is the question.

A lot of what was mentioned in this thread and in the other thread was visited a number of times over the past 20 years. The PRC. VATSTAR. Training Academies. Opinions vary on the successes of those, but if the problem still persists to where 20 years on we are still talking about the same thing, the  the same things we are trying and expecting a different result is what is known as Einstein's Definition of Insanity.

Now, not all is doom and gloom, as I've seen some ideas here that should be taken into consideration. With that, let's dig in:

Possible Solutions:
- Pilot Deviation Reporting - No brainier and everyone above has indicated exactly how I'd go about it. Pilots need to be able to see it so they can learn and grow. Should be managed by the Facility with the ability to be elevated higher if further action needs to be taken.

I really like this idea, as what we should be able to do is if there is a problem, ATC should have a way to log that problem and submit it to the top brass (SUP and above), who should act as the moderators of that. They then send a "please explain" or similar type message to the pilot, either allowing the pilot to explain their side of things or a "these are the rules, you need to be reminded to follow them", etc. In short, SUP and above are the FSDO.

Quote
- Pilot Rating System similar to Pilotege - Their system works. What I like most about their system is you don't have to use it, but you better be good. If you are not good, use this program to get good. Oh by the way, no exam, just get on the network fly and prove that you can perform with a entire network of people around basically 24/7 to help you understand complex concepts/material.

Keith expanded on what we already had here at VATSIM at the time (Keith was the ATM of ZLA here), so he already knew what he wanted to do, but took it more commercially. We could do similar here and should. The issue here is that the ratings system was relative to what the pilot was learning at the PRC, but apparently, the PRC wasn't taken seriously among the rest of the network; it was a recommendation rather than a requirement, because there has been the longstanding ... well.. "common knowledge" (lack of a better word) that anyone should be able to join the network as a pilot, regardless of experience, as this is a learning environment. And while I get that, understand that, and agree with that, we need to hold that learning environment accountable. There needs to be a way to validate that that learning is indeed happening.

Quote
- Controller kill Pilot capability - Remove the problem child when they are a problem (even if not on purpose) and file the report. Maybe they didn't know, but now they do and everyone can learn and grow. The reality is SUP's (to no fault of their own) are poorly equipped to actually decide if a pilot is worthy of a kill as it relates directly to air traffic operations in a "timely" and fair manner. The best equipped people to decide that is the facility. Guy who's frame rates aren't cooperating, kill. Guy who spawns on runway, kill. Guy who leaves computer 20 miles from the field on final freq, kill. File the report. They learn, your scope is manageable again, everybody happy. I imagine the process of the ".kill" is probably more complex, but you get the idea.

I want to say that SUP and higher have that ability, but I can see where as a controller, that ability can be abused. For example, if you know of a certain person that is known to cause trouble on the network, hasn't done anything wrong, but you just don't want to deal with them, having the ability to boot someone off the network just because or out of spite can cause issues that VATUSA doesn't want to deal with, let alone VATSIM as a whole.

I see pros and cons to this, and why it is limited to those SUP and higher. In fact, I've only seen it used twice while controlling: once by Harv or Amy, and the other by GSM, when some idiot using FS2000 wanted to joke around and crash into the WTC.

Quote
I realize that in practice, this is a gross oversimplification of what would be required to establish such a system and VATSIM/VATUSA has come such an incredibly long way over the last year. Most of what needs to be said has already been said and I ultimately want to provide my +1 for this issue.

This wouldn't be that hard to do, as it basically requires a way at the controller client level to be able to log the session (this becomes "the tapes") so that if any pilot deviations occur, they can get sent to the SUPs to be handled. The only drawback with this is that that logged session wouldn't include any logging of voice comms, unless those could be logged at the voice server level (I haven't looked into AFV to see if that's possible). If it is, that's okay. Additionally, the handling of this would have to be at the division level, because a SUP at VATRUS, VATKOR, or VATSA wouldn't have a clue about what we are doing here.


Hey everyone,

*  Pilot fails to contact me in a timely manner.
* Pilot has a language barrier and is unable to contact me in English when the language of the air is English.
* Pilot fails to turn in a timely manner after requested to turn by a controller.
* Pilot fails to understand what "Hold for Release" means
* Pilot doesn't understand that PDC commands via PMs are NOT CPDLC systems and attempts to contact me via telex and uplink messages.

Daniel Kormendy

This brings up another good idea. Pursuant to the Pilot Deviation idea above, one thing that the VATUSA brass could also implement is a "suspension" (again, lack of a better word) of an offending pilot's use of the network pending a slight variation of an Operation Raincheck.

Seeing that all pilots have the OBS controller rating, should they commit an offense more than a couple of times (those offenses being reported; see above), they can not fly on the network until they've visited the ARTCC they've had the problem in, if not the staffed airport in particular to see what the SOPs are for that airport and seen them in action on the network, on the scopes. Yes, this would require them to have a simplistic ATC client installed (shout out to VRC for simplicity) so they can observe the controller and what they should be doing that conforms to SOPs and pilot expectations on the network. This could even be a Sweatbox session or something similar; it just has to be something where the pilot gets a crash course in the area they are having trouble in, and also so they can see how whatever problem they are creating cascades down to others having a problem, which in turn makes everyone's enjoyment of the network turn belly up.

Now, language barriers we may not be able to handle, and quite honestly, that isn't our fault, nor the fault of the network. I've controlled pilots from Japan and Malaysia who could understand English better than they could speak it, so I couldn't fault them for if they couldn't understand what I wanted them to do. All that could help that is patience and giving them the time to set up for what they need.

However, the others fall back onto training and being able to look over the controller's shoulder to see what should happen when it is done right versus what they are doing wrong. They can take that into account, apply it, and they are on the network again. Again, that's logged on a private part of their record (only SUP and higher would have access to that), so should they commit an offense again, they get a sterner warning from the brass; after that, suspension or sacking from the network.

Now, finally, the only other thing any of these (not just my) suggestions need to take into consideration, is that some of these changes would be global, across the entire network. So every division let alone the BoG would need to have buy-in on it, and that is even if their region isn't having such a problem. So it's a big undertaking for us here, but any suggestions would need to be run up to the BoG for those to occur.

BL.
Title: Re: Pilot Expectations, cont...
Post by: Ben Lindsey on July 08, 2021, 01:52:22 AM
Obviously, there's been a relative spike in new users, which anecdotally seem to have a higher rate of competency issues than previous new pilots. One bad pilot is all it takes to ruin a previously good controlling session, so I agree that competency is certainly an issue that needs to be addressed.

I like the discussed idea of a feedback system for pilots, or even something similar to a deviation reporting system. I believe that could go a long way to improving the current situation in a way that allows pilots to improve upon their skills, rather than simply being an annoyance to controllers.

As a controller, it's easy for one particularly bad pilot to ruin a session in which every other pilot had no issues. Any system which can be used to combat common errors or deviations would likely go a long way in reducing controller frustration and the burnout it can cause.

If this type of pilot feedback/deviation reporting system was implemented and run on a global VATSIM-wide scale, this feedback could potentially be used to see global or regional trends. Common issues could be addressed by the Pilot Training Department, and training materials could be created to hopefully curb the issue. If a pilot made a common mistake, a link to that specific material could be sent to them.

I agree with many of the points raised, and in general, I want to give a +1 to the discussion of the issue. Pilot expectations and behavior are a well-known (and often discussed) issue in controlling settings, so just having this discussion in a public forum will hopefully yield some good ideas which can be implemented, potentially on a scale greater than just one ARTCC or VATUSA as a whole.
Title: Re: Pilot Expectations, cont...
Post by: Kyle Sanders on July 08, 2021, 05:52:39 PM

… as this is a learning environment [truncated]… we need to hold that learning environment accountable. There needs to be a way to validate that that learning is indeed happening.

If we were to wrap up this enter discussion into a single idea… this is it!
Title: Re: Pilot Expectations, cont...
Post by: Kyle Sanders on July 08, 2021, 05:53:31 PM

If this type of pilot feedback/deviation reporting system was implemented and run on a global VATSIM-wide scale, this feedback could potentially be used to see global or regional trends. Common issues could be addressed by the Pilot Training Department, and training materials could be created to hopefully curb the issue. If a pilot made a common mistake, a link to that specific material could be sent to them.

If any of this is going to appeal to VATSIM HQ, it’s this^
Title: Re: Pilot Expectations, cont...
Post by: Karl Mathias Moberg on July 10, 2021, 08:13:26 AM
This brings up another good idea. Pursuant to the Pilot Deviation idea above, one thing that the VATUSA brass could also implement is a "suspension" (again, lack of a better word) of an offending pilot's use of the network pending a slight variation of an Operation Raincheck

Unfortunately, this is not something VATUSA could do. VATUSA does not have the power to suspend users, only a SUP or DCRM can do so with the current Code of Conduct and CoR in place. From what I've been seeing from the BoG and the VATSIM meeting minutes, they are in no rush to change that policy.
Title: Re: Pilot Expectations, cont...
Post by: Brayden Manzella on July 10, 2021, 12:21:56 PM
There has been a lot of good discussion and ideas flowing through this thread. We've been having discussions on this topic on and off for many years now with little action actually being taken, both network and division wide. I think now is the time to build on this momentum.

I've discussed this idea with Mani, and I'd like to get a small workgroup put together to see what ideas we can put into place here at the division level to address our relationship with the pilot community. Specifically, looking at a Pilot Community Manager position.

If you're interested in being a part of the workgroup, please shoot me an email or message me on Discord. I'd like to get a meeting setup within the next week or two.
Title: Re: Pilot Expectations, cont...
Post by: Lee Sacharin on July 10, 2021, 09:46:45 PM
A ton of good ideas presented, hopefully not all on deaf ears.  As a online controller (who does not fly the network at all...but does IRL) I have an appreciation for the use of certification, continued training and learning, feedback, and testing.  With all that in mind, the need for annual checking should be included in any environment.  This concept is (for Vatsim) should not be limited to pilots but controllers as well. 

We check an individual to whatever the level (C1, S3, etc.) and never recheck/test them for competency again.  While some do an excellent job, others develop poor habits and deviate from taught standards with no return to square 0.  Does your ARTCC have 'undesirables' or persons who simply need some level of instruction/training whereby they are called out on concerns?  Apply the same logic to future 'rated' pilots here in Vatsim.  They enter the IFR world without any bi-annual requirement...never learning again without checking or feedback.

I understand the difficulties in keeping up with staff to instruct new members without the task of a annual (or bi-annual) review/check.  Increase the work to include the pilot-world and things become even more daunting.

Easy to point out problems and areas that are lacking....viable and achievable solutions, that's where the real talent is.
Title: Re: Pilot Expectations, cont...
Post by: Simon Kelsey on July 12, 2021, 09:57:31 AM
Hi all,

I was pointed to this thread the other day and have been reading with interest! The first thing to say is that I absolutely appreciate the frustrations and I am determined to do whatever we can to reduce those frustrations on both sides of the issue. Many of the ideas in this thread feed in to some work around this that my predecessor, Ethan, was actively looking in to and which I am carrying on.

It's a fine balance between coming up with something which does provide some recourse against those who genuinely have no interest in learning or improving, versus creating an impression of an incredibly stiff, strict, punitive culture where the tiniest mistakes are leapt on and punished with ridicule/bans etc. The problem with that image is that it tends to actually put off those who would actually be quite good VATSIM pilots/controllers precisely because they hear that it's a really realistic, strict environment where they need to have all this knowledge before connecting and so they never do because they're worried that they don't know enough and if they mess up they'll be kicked. Meanwhile those who really don't care just connect anyway and so it ends up being counterproductive and having the opposite effect to that intended! We need to make sure that we are learning from and promoting the real-world "just culture" concepts and making it really clear -- internally and externally -- that we want to hear about and learn from honest mistakes, and that honest mistakes and genuine efforts will never be punished, only clear negligence/acting in bad faith.

With regard to the feedback/ATSAP idea -- this is absolutely a good idea. In the first instance if we want to tackle this problem -- and, just as importantly, identify whether any progress has in fact been made -- we need proper data and this is something which is currently lacking. Of course we have anecdotal comments and experiences shared in forums like this, in the VATSIM Discord and so on but to be honest -- I've been reading similar comments to some degree or another for the last 21 years and beyond! To collate and analyse some proper data we need a proper feedback system and that is something which we are actively working on and I hope to have something to trial in the not too distant future.

One of the challenges with the above is that I am keen that it is NOT simply a "moan form" for controllers to point fingers or sound off about individual pilots because I 100% guarantee that if one pilot is having difficulty with something so will somebody else on the network and just like in real aviation we need to make sure we are using the data to focus on putting resources in place to address the issues more widely for everybody, and not just targeting individual "bad apples" and pretending that by punishing/removing those we are going to remove the problem. Supervisors and .wallop must remain the primary port of call for dealing with members who are being disruptive or in breach of the CoC in individual cases -- and I appreciate that at times this can be a bit more painful than it ought to be and we can discuss about that.

I know the New Member Orientation Course is something which has had some discussion -- I agree that whilst it was a huge step forward to implement this in the first instance, there are definitely improvements that can be made here and it's a project I have running at the moment. Again, armed with data and feedback I want to make this a process of continuous improvement and development so that we are always refining and making sure that we are targeting the important/live issues through the course, so watch this space in that regard.

I strongly believe that ATOs and the Pilot Rating system are an integral part of improving the overall levels of knowledge and skill on the network -- the fact that we now have the pilot ratings more easily visible in tools like VATSpy etc I think is a great step forward and we need to keep on working at ways to make pilot ratings more visible, more attractive and more aspirational. With that in mind I appreciate that capacity in the system at present is nowhere near what it needs to be and I have some plans for how we can improve upon this which I hope to say more about soon.

Finally, alongside the formal pilot ratings we also have to do much better at getting information, training material and so on out there to a much wider audience on a more informal basis -- and that's something which I want to work with the Marketing team on. I'm open for thoughts and suggestions on this as well -- I know the Boston guys have been running webinars in the past which I think is a fantastic idea and I'd love to see more of the same so if there's anything I can do to support that -- likewise I really want to make the PLC a 'destination' for aviation knowledge so if anybody wants to write up an article or a guide etc that they would like to see published on the PLC by all means send it across -- my e-mail address is on the VATSIM Staff page under VP Pilot Training (even if my name is not yet!).

Hope that gives a whistlestop overview of some of the plans we have to try and tackle some of these issues -- as I say I think the most important thing in the first instance is to get the feedback/ATSAP programme in place which in turn will give us the data we need to know what we need to be focussing on and to see whether our efforts are actually having any impact.

As always, my virtual door is open so if you have any thoughts or comments I'm delighted to hear from you!

Best,

Simon
Title: Re: Pilot Expectations, cont...
Post by: Brad Littlejohn on July 12, 2021, 02:04:47 PM
This brings up another good idea. Pursuant to the Pilot Deviation idea above, one thing that the VATUSA brass could also implement is a "suspension" (again, lack of a better word) of an offending pilot's use of the network pending a slight variation of an Operation Raincheck

Unfortunately, this is not something VATUSA could do. VATUSA does not have the power to suspend users, only a SUP or DCRM can do so with the current Code of Conduct and CoR in place. From what I've been seeing from the BoG and the VATSIM meeting minutes, they are in no rush to change that policy.

Hence why I said that this would have to have buy-in from the BoG and every other division. Such a change like this would have to be done NETWORK wide, not just division-wide. Because of that, it needs to be seen if the same pilot issues we are having at VATUSA are also happening in the other divisions; as VATUK, VATSA, VATNZ, VATEUR, and VATEUD are seeing a lot of traffic, are the same piloting idiocies happening there as they are here. If they are, then there is our justification for taking this to the BoG and letting them talk it out.

I know RJ frequents this forum, doesn't live that far from me, and still has some pull at the BoG, as well as Don. I'm more than sure they are aware of this and also could take up the mantle and see how far it can go.

BL.
Title: Re: Pilot Expectations, cont...
Post by: Robert Shearman Jr on July 12, 2021, 02:34:33 PM
Considering that the member of the BoG who is directly responsible for Pilot Training just answered this thread in the post above yours, I'd say we have it on good authority that we have attained their audience with our concerns.
Title: Re: Pilot Expectations, cont...
Post by: Don Desfosse on July 12, 2021, 05:40:35 PM
^ This :)  Yep, as much as some people think BoG isn't paying attention, I can assure you that we talk about pilot quality, feedback mechanisms, balance, preventing against abuse, and tradeoffs quite often.  And as much as some people think all the BoG cares about is quantity over quality, I can assure you that can't be farther from the truth! 

Simon was just appointed in his role, and has read this with significant interest.  He is new to the conversation at the BoG level, but is jumping in with both feet.  I, and many of us, look forward to what will come.
Title: Re: Pilot Expectations, cont...
Post by: Andrew Selder on October 02, 2021, 10:20:45 PM
Hi all,

I was pointed to this thread the other day and have been reading with interest! The first thing to say is that I absolutely appreciate the frustrations and I am determined to do whatever we can to reduce those frustrations on both sides of the issue. Many of the ideas in this thread feed in to some work around this that my predecessor, Ethan, was actively looking in to and which I am carrying on.

It's a fine balance between coming up with something which does provide some recourse against those who genuinely have no interest in learning or improving, versus creating an impression of an incredibly stiff, strict, punitive culture where the tiniest mistakes are leapt on and punished with ridicule/bans etc. The problem with that image is that it tends to actually put off those who would actually be quite good VATSIM pilots/controllers precisely because they hear that it's a really realistic, strict environment where they need to have all this knowledge before connecting and so they never do because they're worried that they don't know enough and if they mess up they'll be kicked. Meanwhile those who really don't care just connect anyway and so it ends up being counterproductive and having the opposite effect to that intended! We need to make sure that we are learning from and promoting the real-world "just culture" concepts and making it really clear -- internally and externally -- that we want to hear about and learn from honest mistakes, and that honest mistakes and genuine efforts will never be punished, only clear negligence/acting in bad faith.

With regard to the feedback/ATSAP idea -- this is absolutely a good idea. In the first instance if we want to tackle this problem -- and, just as importantly, identify whether any progress has in fact been made -- we need proper data and this is something which is currently lacking. Of course we have anecdotal comments and experiences shared in forums like this, in the VATSIM Discord and so on but to be honest -- I've been reading similar comments to some degree or another for the last 21 years and beyond! To collate and analyse some proper data we need a proper feedback system and that is something which we are actively working on and I hope to have something to trial in the not too distant future.

One of the challenges with the above is that I am keen that it is NOT simply a "moan form" for controllers to point fingers or sound off about individual pilots because I 100% guarantee that if one pilot is having difficulty with something so will somebody else on the network and just like in real aviation we need to make sure we are using the data to focus on putting resources in place to address the issues more widely for everybody, and not just targeting individual "bad apples" and pretending that by punishing/removing those we are going to remove the problem. Supervisors and .wallop must remain the primary port of call for dealing with members who are being disruptive or in breach of the CoC in individual cases -- and I appreciate that at times this can be a bit more painful than it ought to be and we can discuss about that.

I know the New Member Orientation Course is something which has had some discussion -- I agree that whilst it was a huge step forward to implement this in the first instance, there are definitely improvements that can be made here and it's a project I have running at the moment. Again, armed with data and feedback I want to make this a process of continuous improvement and development so that we are always refining and making sure that we are targeting the important/live issues through the course, so watch this space in that regard.

I strongly believe that ATOs and the Pilot Rating system are an integral part of improving the overall levels of knowledge and skill on the network -- the fact that we now have the pilot ratings more easily visible in tools like VATSpy etc I think is a great step forward and we need to keep on working at ways to make pilot ratings more visible, more attractive and more aspirational. With that in mind I appreciate that capacity in the system at present is nowhere near what it needs to be and I have some plans for how we can improve upon this which I hope to say more about soon.

Finally, alongside the formal pilot ratings we also have to do much better at getting information, training material and so on out there to a much wider audience on a more informal basis -- and that's something which I want to work with the Marketing team on. I'm open for thoughts and suggestions on this as well -- I know the Boston guys have been running webinars in the past which I think is a fantastic idea and I'd love to see more of the same so if there's anything I can do to support that -- likewise I really want to make the PLC a 'destination' for aviation knowledge so if anybody wants to write up an article or a guide etc that they would like to see published on the PLC by all means send it across -- my e-mail address is on the VATSIM Staff page under VP Pilot Training (even if my name is not yet!).

Hope that gives a whistlestop overview of some of the plans we have to try and tackle some of these issues -- as I say I think the most important thing in the first instance is to get the feedback/ATSAP programme in place which in turn will give us the data we need to know what we need to be focussing on and to see whether our efforts are actually having any impact.

As always, my virtual door is open so if you have any thoughts or comments I'm delighted to hear from you!

Best,

Simon

Holding pilots accountable doesn't need to mean "incredibly stiff, strict, punitive culture where the tiniest mistakes are leapt on and punished with ridicule/bans etc"

A pilot repeatedly screw up SIDs and gets frequent reports for this, this is noticed by a staff member, who sends a nice email, saying "we've gotten feedback that you're having trouble following departures, do you have 15 mins we can pop in a voice chat so I can explain them a little better".

If the complaints continue, next step would be requiring an hour or two of training or observing ATC so they can see how their mistakes impact the system.

If the problems still persists, then maybe need to start restricting privileges.

--------
I realize it would probably be ignored by the majority, but just like airline dispatches have a place for the pilot to sign that they are prepared for the flight, have reviewed the flight plan etc... how about we add a check box to the bottom of the flight plan dialog with some thing like: "By checking this box, I certify that I have reviewed the flight I am about to perform, I have reviewed the pertinent charts and have sufficient skill to execute the flight."

Title: Re: Pilot Expectations, cont...
Post by: Ryan Barnes on October 03, 2021, 09:48:55 PM
I'm going to play devil's advocate and share my 2 cents.

The last time I connected to VATSIM was on January 9th, 2021. I have since "retired" due to burnout and what I'm about to explain. To put it simple: This hobby was starting to feel like a minimum wage job.

The network has been going more into this whole "realism" direction especially the last few years. I miss the days where I could actually have fun controlling and helping pilots out when they had no idea what they were doing. It seems we reached the point where we try to hold controllers to the highest standard possible, but of course pilots aren't, and I think we are trying to be too realistic to the point where we are making it so new pilots have to go through some kind of test to satisfy our realism needs. I know the argument will be made where "I have fun doing things ultra realistic" and such, but I'll say in m opinion it's at the point where I'm not having fun because of it. There needs to be more of a focus on actually helping the pilots at the time they need it instead of just going straight to "oh lets just put them through the same training us controllers go through" which to me when I left was getting insane too. (I couldn't stand sweatbox sessions where they give you 50 something planes at once while if you controlled on a random afternoon you got 15ish)

Another thing too is if we're going to force pilots to go through some kind of testing to satisfy these realism needs, we should enforce live weather, and current time while we're at it. Nothing stopping me from spawning in at a controlled field with LIFR conditions, 100KT wind and an altimeter of 2980. Nothing stopping me using scenery that would be accurate as of 1980.

It is these frustrations with they way the network has gone towards to make me forget controlling, the pilots were not the issue, it was the this mindset that made it not fun.

I check back in another couple months.