ACARS Project Progress |
|
|
Project Progress2024-12-14 Hoppie's ACARS is back online after not even 3 hours. Thanks to the great people at Soleus.nu for the painless move! 2024-12-13 Due to less than expected quality of service in the current co-location center, we will move a few rack units of equipment to another center, also near Amsterdam. The move will start 1300Z and hopefully the system won't be down for more than a few hours. 2024-12-12 The hosting facility of Hoppie's ACARS had a major power outage, but it seems to be all okay again now. The server was down for nearly two hours. 2024-12-12 New function: ACARS system status in JSON. May still change a bit. https://www.hoppie.nl/acars/system/status.html 2024-12-08 Due to load balancing issues on the host machine that Hoppie's ACARS runs on, there are periods of time when the load of the whole machine slows down the ACARS service. Usually this is not an issue, but there is older client software out there that in such a situation may err and then basically releases a DoS attack on the server. It shows up as one callsign requesting for example a METAR a few hundred times in two seconds. This bogs down the server for a few minutes but it will solve itself. 2024-12-01 A different presentation of this same "project progress" message list is now available as a NOTAMS page, suitable to be embedded in any other system's dashboard. Get it at: http://www.hoppie.nl/acars/system/notam.html It's a flat text file that is at most 80 characters wide and may contain URLs but from now on no HTML. For now, the messages are displayed only if their date lies between 2 days in the past and 7 days in the future. 2024-11-21 On Thursday November 21, there may be service interruptions due to works on the power supplies of the datacenter where Hoppie's ACARS is hosted. The effect, if it happens, will be simple complete absence of any response on the usual web API or the web sites on www.hoppie.nl. Apologies for any disturbance, hopefully it will be brief. 2024-11-13 The datacenter where Hoppie's ACARS is hosted announces possible power interruptions between 17 and 23 November. When more details become available they will be mentioned here. 2024-10-27 18:00z While not taking the system down, I inserted a cache to cover the most used database queries. This has brought the system load down to a few percent while pulling 1500 users. So at least this solves the performance issues. What now remains is to fix a lot of clients out there, including ATC clients, that use the available API in ways that are not sustainable. I invite all ATC developers to contact me if they need a feature and they think the current API cannot do it while there really is no other way to build their ATC software. For example, asking for a list of all callsigns online every six seconds is NOT the way to do it. And there are a lot more of these, such as airplanes that use PEEK instead of POLL. These things really need to be cleaned up. 2024-10-26 08:30z I found and removed a few stone age features (literally 20 years old) that are no longer useful, this seems to help a lot. Let's see what this weekend brings. 2024-10-25 The system has performance problems that I don't yet understand. It feels like either the network or the underlying disk turned a lot slower since this morning about 10:00z. While I try to figure this out, I added some emergency brakes to the system, in the form of error notices. The list of notice types will grow; they can be seen on the new ACARS Notices Page. I apologize for the inconvenience; I try to get this back in working order as soon as I can. 2024-10-23 The issue with PMDG clients has been solved. It was due to a misunderstanding from my side -- apologies to everybody affected. One client is known now that cause issues. IVAO's AURORA ATC station uses a method to get information that is too heavy on the system but works correctly as long as the load is low. I contacted IVAO about it and have not yet received a response. 2024-10-21 I believe some software got released yesterday that does not talk to the ACARS system in the correct way. I will start e-mailing the accounts causing the issue to see whether I can get confirmation they all run the same software and if so, hopefully the software developer will correct the problems. Please DO NOT POLL for no reason and not more than ONCE PER MINUTE. 2024-10-20 At about 16:00z something external started putting a significant load on the ACARS server. It had easily survived higher loads in the past so something changed out there. The result is that even a smaller number of ACARS users online now leads to unacceptable response times. The load fluctuates s lot and despite me switching off some "expensive" features such as external METAR and ATIS lookups, the system remains in a state of regular overload. 2024-09-18
The server swap went smoothly. Hoppie's ACARS was unavailable for about 18 minutes. Thank you for your patience. 2024-09-14 UTC morning of September 18, between 0500z and 1100z, the ACARS service will move to a new host, for maintainability and performance reasons, and also to save on expenses. 2024-05-04 For the client developers out there: please consider to implement the new suggestion about not starting to poll unless the aircraft has sent anything. 2024-04-21 Those changes seem to have worked wonders. The system now pulls over 1000 parallel users without blinking. I've also extended the maximum length of names and e-mail addresses. 2024-04-20 I'm disabling various noncritical interfaces to reduce the system load. There are software clients out there that respond in a bad way to increased waiting times for connections. Any client should be able to cope with 20-30 seconds of waiting time without doing something silly, like firing dozens of similar requests per second. This makes the matter only worse! Please, if you program an ACARS client and you detect a long latency or other problem that probably is a performance issue, back off and reduce your polling rate. Go from once per minute down to once per two minutes. No it ain't great, but that keeps the system working properly. 2024-04-01 Lately we have seen a large (I mean LARGE) increase in system load due to many more clients appearing that are heavily using CPDLC. I am not entirely sure but I think there are a few robot servers doing airport clearances and such. This is not an issue in itself, but the speed with which these bots seem to work invites rapid-fire message exchange which isn't what CPDLC is about. If at all possible, I would like to see a bit more delay between receiving a request and responding. Especially if the client software detects a long waiting time for a connection (five seconds, ten seconds) which indicates that there are a lot of other clients battling for connection time. The vast majority of clients is just checking for messages. So what about this: If you detect a long waiting time for a connection, please drop your polling rate. This "should" make the system self-stabilizing. 2023-11-20 Somewhere in November 2023, Hoppie's ACARS quietly passed the 10 million message milestone! Since its inception in the very early 2000s, tens of thousands of users have together exchanged over ten million messages. Quite something to celebrate. 2023-11-04 A more specific gap detector is now operational. Users that poll more than once per 20 seconds simply get "no new messages for you" returned for 20 seconds. This does not impact anybody really but reduces the system load as no further database searches or traffic is required. If your software still has issues with this server fix, please contact me and we will attempt to find a workaround. Many clients have set their poll rate at 5 seconds and this is simply never needed, please SET IT TO A MINUTE. 2023-11-03 I temporarily switched off the connect gap detection as some clients have been programmed with several connections in rapid succession. This is unfortunate because it means the system will again slow down today. As soon as I can, I will make a more complex gap detector that should only block truly harmful client connect bursts. It may lead to brief service interruptions over the coming days. For client developers: please be considerate when firing off multiple connect() requests in a burst, for example to retrieve several METARs or ATISes. Please insert a bit of delay between them, like a second. The system was never designed to handle multiple clients all using bursts. It easily leads to the well-known "just over the edge" phenomenon where the performance collapses as suddenly everybody starts to pile up. 2023-10-29 It looks like there is a new ACARS client out there that is ultra-agressive, both in polling rate and in retries. The number of messages per 24 hours exploded from about 7000 to over 30000 and many are simple duplicates. Usually I see about 30 duplicates in a few seconds coming from the same callsign. All of these are treated as individual messages so this is tough on the system. If you experience slow response, this is probably the reason. To sort of stop this, I've implemented a mandatory waiting time between polls of 10 seconds. If your ACARS software polls faster, it will get error returns until it slows down. It's crude but it already seems to help. Please reduce the polling to about once per minute! 2023-07-30 New information request: "peatis" for Pilot Edge ATIS messages. New telex workaround: "HC001" to ask for a Pilot Edge ATIS if your ACARS client does not have the "inforeq peatis" implemented (yet). More info. 2023-07-29 It remains remarkable that this hobby system, which I started around the year 2000 as part of the (long defunct) Squawkbox for PS1, now has led to a large number of real wide body aircraft to routinely cross the oceans under ICAO PBCS rules. In 2011 I made a career switch to start developing real avionics for real aircraft and over a hundred wide bodies now fly my software. No it is not the same ACARS software that runs on "my" Iridium SATCOM gear aboard these planes, but it surely is the same concept, the same thinking, and the same design principles. Sometimes, a hobby really teaches you how to do things properly. 2023-07-07 It seems that IVAO fixed the bug. Lately I see no more binary garbage messages at all. Good! 2023-02-19 I'm tracing a probable bug in an ATC program used by IVAO (only). It seems to attach random binary garbage to CPDLC messages, which often but not always leads to the ACARS server simply discarding the message. It is not just accented letters or so, it really is a couple of dozen binary bytes that look like random memory, previously used to contain various other things such as HTML. As in, a few random stack frames until there was a zero. If anybody can suggest which program this may be and who is its developer then we may be on our way to fix it. 2023-01-28 As most airplane or controller software for Hoppie's ACARS is provided by third parties, I started a list of client software. Please help me out by submitting known client programs to my e-mail address. 2023-01-13 He's back. Fun. 2022-11-12
After 20 years, the funny people of the internet have found that bothering others during their hobby is a wonderful way to pass the time. I had to shut down various parts of the ACARS system to dim their enthusiasm a bit. Hopefully they will grow up and we can restore the system to what it can be as long as everybody behaves like an adult. 2022-07-02 Thanks to the cooperation of many people, the ACARS system has stabilized nicely. With over 15,000 registered active users and regularly over 700 users online at the same time, the small server doing all the work rarely exceeds 50% load. Not bad for a design that is over 20 years old. 2022-06-06 A bug in the ping command prevented network filtering for stations online. Thanks to Jonas Kuster for pointing it out. The dispatch file stores still need to get the same modification and I hope to get this done this week. 2022-06-05 As ACARS popularity keeps increasing, a few new guidelines have been written to better keep the server load in check. This is mostly relevant for the developers that write ACARS client software. See the technical documentation for details. 2021-07-10 Work has started to include the network affiliation of the ACARS users into the system logic. For a while, multiple virtual airspace organisations have been using this ACARS system at the same time, which of course causes clashes for airport names if they are staffed on more than one network. Adding one network affiliation per user should go a long way in solving this. If you want to discuss this technically, please join at this Forum: Aerowinx 744 Forum. 2020-07-05 A repeat of an older message to get it back on top of the list: If your ACARS claims "PLEASE UPDATE YOUR ACARS URL SEE WWW.HOPPIE.NL/ACARS", then your old ACARS client software still refers to a network connect URL with 'flightline' in the string. Please replace this by the correct URL:
Since most of the ACARS client software in use today is not written by me, I will usually not be able to help you with the URL update. Please consult your software supplier for the instructions. 2019-06-23 Today I looked at the counter of active accounts, which shows the number of accounts that have seen activity in the last 90 days. ACARS currently has over 3000 active users! There are over 800 users registered that have never logged on yet, most of these probably never will and these passive accounts will expire automatically after 90 days of passiveness. 2019-05-01 Netcraft has officially withdrawn their complaint and determined that their warning nr. 6025501 was a false positive. 2019-04-29 There are suddenly warnings floating around that the ACARS-for-MSFS single installer, available from https://www.hoppie.nl/acars/prg/acars-msfs/, is a malware distributor: https://incident.netcraft.com/3bf/3bf4169074b5 As far as I can track it, it was last restored from backup in February 2018 when I moved my server and it still is the same as when I originally compiled it in August 2010. Even the Wayback Machine has exactly the same file dated 2016. 2019-04-14 The inevitable happened: some funny guy (statistically it must be a guy) has used the ACARS system to spread offensive stuff among unsuspecting pilots. As the system was not designed to weed out jokers with surgical precision and ban them for good from the planet (there was no Facebook or Twitter or Google with omnipotent identity cancelation powers 20 years ago), I am currently contemplating how to stop the comics. So please beware the jokers and give me some time to come up with a workable solution that fits in with our hobby. What do pilots do when there is a joker on the frequency? (hint) 2019-02-09 I added TLS (HTTPS) to the web server. However, many client software packages do not work yet with HTTPS, so you may try but the URL below is what is guaranteed to work.
2018-02-25 Nothing changed, except the hardware, operating system, database, programming language revision, country of the server location, IP address, and some other details of the system. IMPORTANT: older (>10 years) ACARS client software still refers to a network connect URL with 'flightline' in the string. Please replace this by the correct URL:
2013-11-01 It is that time of the year again. ACARS and a lot of other systems are being set up to support WorldFlight 2013 as usual. Please take a moment to look into this major online event and fly along if you can! 2012-11-03 ACARS has been switched into Worldflight Mode. This means that some lists and most maps are now only showing aircraft known to participate in Worldflight. If you participate and do not get listed, just mail me (address at the bottom of the page). 2012-11-01 Due to an unexpectedly loud default sound level, the ATC (CPDLC) application turned out to be rather jumpy. I added a volume control slider to the Setup dialog. Version 1.5.1, here. 2012-09-22 It is that time of the year again ... while the teams prepare for their epic journey around the globe, the ACARS system undergoes maintenance to make it ready for 24/7 support of the logistics. 2011-11-11 V1.9 of the aircraft client fixes up a few snags in the formatting of position report times and the inflight ETA. It also offers a convenient shortcut if you manually update the ETA and want to send the OOOI report ahead of automatic time. 2011-10-24 V1.8 of the aircraft client integrates VATSIM ATIS requests. This feature is still being fine-tuned at the server site, it will improve over the next days. 2011-10-03 This date marks the moment in time that I officially crossed over from doing hobby ACARS in Europe, to doing professional (Iridium SATCOM) ACARS in the USA. In hindsight from 2023, who would have dared to predict the results? 2011-05-07 V1.4.1 of the ATC client offers a poll interval setting in milliseconds. 2010-11-09 ACARS just reached the 400 active accounts mile stone. Thanks to this rather large user base for such a niche system, I am still committed to keep it running! 2010-11-07 ACARS has been switched back to normal operation after a brilliant World Flight 2010. Hope to see you all next year! 2010-10-31 Worldflight 2010 has been made active on ACARS. Some features, such as some maps, are dedicated to just Worldflight aircraft until Sunday November 7. If you want to join Worldflight, just send your aircraft callsign to hoppie@hoppie.nl. More info at my Worldflight blog. 2010-10-23 In preparation for Worldflight 2010, I've added (guarded) Twitter bridging to certain ACARS message types linked to certain accounts (logon codes). To follow Worldflight, use for example http://twitter.com/Worldflight. 2010-09-11 A new documentation page was added to explain how to enable the ADS-C transmissions from an aircraft, so that it appears on the global aircraft position map. 2010-09-05 The ATC client has been updated with various usability features. The most noteworthy ones are: 1. transparent secondary windows, 2. options to make the secondary windows less intrusice, 3. Reply-via-CPDLC button in Telex (ACARS). 2010-08-28 I am busy adding interface sugar to the ATC program (the CPDLC client) to facilitate the integration with any radar scope out there. Controllers are invited to participate in the development by downloading the client and giving feedback on the VATSIM forums (Controller Talk, preferably). 2010-08-22 By popular demand: the ACARS all-in-one installer for MSFS. Now you just download one package and do next-next-finish to get it all running. Ok, you still need your logon code. 2010-08-22 ACARS is getting more popular. After several years of putting myself in between the logon code requests and the ACARS system, I took the plunge to open up the self-service registration. Hopefully the trolls stay away. 2009-10-17 World Flight 2009 is coming up fast. As always, ACARS plays an important role in this event. Operationally it is used to coordinate many issues, and the maps it generates are very nice for event dissemination. There is more information online about how to use ACARS during WF2009. 2009-06-07 To facilitate nice maps for web sites of Virtual Airlines, I added a feature to the world map. You can now filter for all airplanes that share the prefix of a callsign, such as "BAW". 2009-06-07
A research project at George Mason University (DC) required a shorter polling cycle than 60 seconds. The new 2009-02-15 One of the long-standing ToDo items was to enable the ATC position report. It is now an exact copy of the FANS-1 variant, which is shared between FMC PROG, FMC COMM, and ATC modes (and therefore cannot return to anything, just as in reality). V1.7. 2008-10-12 In preparation for World Flight, I added a VisualPS1 offset detector to the ACARS Airborne Client V1.6. This is only of use for people who use VisualPS1 with IPC 2.8, probably just two on the Earth. All the others may leave this selection in Setup undefined. 2008-09-13 ACARS Mini Server full "ping" implementation, which enables the ATC client to not time out planes that are quiet but remain online. Release 0.4. 2008-09-07
The CPDLC system got a significant extension: ATC stations may now relay route files to planes via CPDLC. Of course not all sims know how to handle route files, but this is "not my problem" :-). Both a new ATC station and a new Airborne Station required. 2008-08-22 V0.3 of the ACARS mini server fixes an irritating bug that blocked all CPDLC message exchanges. A case of trying to be too clean in data sanitising... 2008-08-13
Dispatch has a new release, with the option to change the sound file now in Setup, and also the option to change ACARS servers. Typically you want "localhost" if you run the mini ACARS server yourself. 2008-08-11 In preparation of the new ACARS mini server, the Airborne Station got the option to select a different ACARS server URL. Also added a switch to select pure UTC time on the clock, instead of listening to a connected simulator. The program is now called differently and installs in a different location, which will be my new installation pattern. 2007-10-28 New Dispatch Client, updated with recent developments around TOPCAT and such, sound, and now packaged with a Windows installer. Also new Airborne Client, with manually editable OOOI fields in case you don't have working data feed. 2007-10-26 Airborne 1.2 has integration with TOPCAT and also allows downloading FMC route files for other sims than PS1. 2007-10-21 Better internal structure leading to bugs fixed in the airborne client. 2007-10-20 Bugs fixed in the CPDLC client (ATC) that mixed up the effects when a CPDLC message came in with those for telex. 2007-10-12 Pre-Departure Clearance added, printing logic restored to a sane state, and a few minor cosmetical fixes. V1.0 with Windows installer. Armable reports still absent, which probably nobody will notice anyway. 2007-09-30 Emergencies and When-Can-We added, ATC keystroke logic improved (the MCDU cannot detect holding the ATC key down, but it can detect pushing it twice within two seconds -- this will get you to the Emergency page straight away). Many smaller things fixed up. It now gets somewhere. Major thing lacking: armable (automatically sent) reports. 0.7.5. 2007-09-29 Reports added and Verify totally rewritten in the airborne client 0.7.4. 2007-09-22 Small polishings and a Windows installer instead of a plain .zip file. 2007-09-21 Full addition of the telex capability so that controllers have both communication systems in one client program. Sound library still not configurable except by overwriting the meepmeep.wav file. 2007-09-19 Quick and dirty addition of a sound when a CPDLC message comes in. Will get configurable. Please report whether it works. 2007-09-18 Airborne client up to 0.7.2. Fixed a problem with complete ATC log printing (from the ATC Index Page) and added some white space at the bottom of each print, for typical flight deck printer form feed. 2007-09-15 Airborne client up to 0.7.1. Can now print and some leftover items from SB747 have now been removed. 2007-09-15 ATC client up to 0.7.1. Now has usability improvements for departure clearances and other long messages that repeat often, window management aimed at ATC scopes, and messages to planes not yet logged on. 2007-09-14 New releases 0.7 of airborne and ATC clients. Plane handover between centers included (look into the COMM message cluster) and lots of loose ends tied up. 2007-09-08 New release (0.6) of airborne and ATC clients. All required functionality is in there now, just a few bells and whistles missing. 2007-09-06 Busy redoing the ACARS web site. It was a mess, getting better now. 2007-08-19 The latest beta release of the airborne client gets closer to what it should eventually be. Serious usage of this is possible by now. The web site is getting better, slowly. 2007-07-04 As I slowly fix all open issues and add more and more pages to the airborne side of CPDLC, the thing becomes actually usable. 2007-06-20 CPDLC beta released, both ATC and aircraft side. Still needs work though. 2007-03-11 Start of ACARS revamp, including all web sites. |
| © 2024 Jeroen Hoppenbrouwers All rights reserved, including those for text and data mining, AI training, potato stamps, and similar technologies. | For more information, mail to hoppie@hoppie.nl |