MPC Status Page
The MPC is in preparation mode. Further details on what this means can be found here
This page describes enhancements to and problems that have occurred with the MPC's webpages and scripts and the fixes that have been made. Resolved problems will remain in the Outstanding Problems sections for a brief period after resolution before being moved. This page will also try and give advance notice of the unavailability of these services due to network maintenance.
Unless otherwise indicated, all times on this page are UTC times. Prior to 2010 Nov. 7, the times shown are local times (either Eastern Standard Time [UTC-5h] or Eastern Daylight time [UTC-4h], as appropriate).
Any enquiries to the MPC can be addressed via the Jira Helpdesk.
Status Messages and Outstanding Problems
- Delayed DOU email 2023 Feb 22 14:00. The DOU email was delayed due to a file size larger than usual. We have increased the size of our email server. The issues have been solved, the email has been sent and operations are back to normal.
- Delayed DOU 2023 Jan 26 15:57. The DOU was delayed due to some internal problems. The issues have been solved and operations are back to normal.
- NEA Planning Aid is now working 2023 Jan 24 04:00. The NEA Planning Aid has been restored.
- NEA Planning Aid unavailable for a couple of hours 2023 Jan 23 22:11. The NEA Planning Aid has been unavailable for a couple of hours. We apologize for the incovenience.
- MPC Database Replication 2022 Jul 14 10:45. The SBN servers used to replicate the MPC's database are now restored.
- MPC Database Replication 2022 Jul 13 08:49. The SBN servers used to replicate the MPC's database to the external user-community are currently offline due to a power outage.
- Scheduled maintenance of astrometry processing system 2022 Apr 18 01:00. The scheduled maintenance has been completed.
- Scheduled maintenance of astrometry processing system 2022 Apr 13 19:50. The MPC will be performing a scheduled maintenance of its astrometry processing system on Sunday, April 17 from approximately 20h-24h UT. Observers will still be able to submit astrometry via email or curl during this period but it will not be processed until the system is back up and running. The MPC website will not be affected.
- Truncated lists on the MPC list and plot page
2022 Apr 07 19:58. The lists have been restored. - Processing of Submitted Observations
2022 Apr 03 20:19. The delay in processing submitted observations is now resolved. Normal operations have resumed. - Processing of Submitted Observations
2022 Apr 03 17:00. Processing of submitted observations is currently delayed. We are working to restore operations. Any observations submitted will be processed and acknowledged when service is restored. - SSL Certificate Expiration
2022 Feb 02 16:04. The server issue has been resolved and normal https access to https://www.minorplanetcenter.net/ has been restored. - SSL Certificate Expiration
2022 Feb 02 13:21. The MPC is aware and in the process of fixing the issue with the expiration of the MPC SSL Certificate. This has affected a number of services but the NEOCP can still be accessed via HTTP. - WAMO
2022 Feb 01 03:00 The MPC's WAMO service has been restored to operational status. - WAMO
2022 Feb 01 01:00. The MPC's WAMO service is not operational at present. We are working to restore service. - Processing of Submitted Observations
2022 Jan 26 19:56. The delay in processing submitted observations is now resolved. Normal operations have resumed. - Processing of Submitted Observations
2022 Jan 26 17:26. The MPC is currently experiencing delays in the processing of submitted observations. The processing is working but it is very slow. We are actively working on fixing this issue. - Scheduled Maintenance
2021 Oct 1 01:50. The scheduled maintenance has been completed. - Scheduled Maintenance
2021 Oct 19 03:00. Smithsonian is performing a software upgrade to resolve security vulnerabilities for server switches. The timeframe for the upgrade has been scheduled to take place Thursday, Oct. 21 some time between 0h UT and 3h UT. This will result in service interruption at minorplanetcenter.net for several minutes. - DOU's issues resolved
2021 Sept 21: 17:51. The issue has been resolved and a new corrected DOU has been issued. - DOU's issues
2021 Sept 21: 16:54. Today's DOU contains the correct number of orbits, but not the correct number of observations. - Minor Planet Circulars
2021 Aug 10: 17:15. We have started preparing the August MPCs. - Planned network outage
2021 July 29 14:25. Network has been restored. Operations are back to normal. - MPChecker issue
2021 July 27 20:45. The problem with the MPChecker data files has been resolved. - Planned network outage and recent MPChecker issue
2021 Jul 26 19:00. There is a planned network outage at the facility where the Minor Planet Center's pipeline servers reside. The outage is scheduled to take place on 29 July 2021 from 00:00 UT to 02:00 UT. The processing pipeline will be paused during the outage, but the web server will remain operational. The MPC is also aware of the recent issue with MPChecker and it's working to update the necessary data files. - Planned power outage
2021 Jun 12 21:30. Power has been restored. The processing pipeline is back in operation. - Planned power outage
2021 Jun 12 09:45. There is a planned power outage at the facility where the Minor Planet Center's pipeline servers reside. The outage is scheduled to take place on 12 June 2021 from 10:00 UT to 22:00 UT. The processing pipeline will be paused during the outage, but the web server will remain operational. - Working remotely: Normal operations
2021 Mar 12 17:15. The latest version of MPCORB.DAT was missing a number of orbits, in particular for newly numbered asteroids. The problem has now been solved. - MPCORB.dat
2021 Mar 6 01:55. The latest version of MPCORB.DAT is missing a number of orbits. We are investigating and working to correct the problem. - Contacting the MPC
2021 Feb 17 13:18. The MPC wants to encourage the community to start using Jira to report problems or to direct questions or suggestions to the team. Various links to contacting the MPC have been redirected to Jira, including the contact link. Any feedback on the changes are welcome via the Jira Helpdesk. - Working Remotely: Temporary Service Interruption
2021 Feb 17 13:18. The worldwide outage of Google services affected the MPC, particularly observations submitted via email. This appears to have been resolved. - MPEC Numbering Issues
2020 Dec 13: 13:12. The errors in the numbering of recent MPECs have been corrected. We are working to prevent a recurrence of this kind of problem. - MPEC Numbering Issues
2020 Dec 05: 23:06. The errors in the numbering of recent MPECs corrected have been corrected. M.P.E.C. 2020-X21 provides details. We are working to prevent a recurrence of this kind of problem. - MPEC Numbering Issues
2020 Dec 05: 15:08. We are aware of issues with the numbers of a few recent MPECs. We are working to resolve the problems. We will announce the corrections when they are complete. Affected MPECs include 2020-X01, 2020-X02, and 2020-V103. - MUG Meeting
2020 Dec 02: 10:30. The MPC and SBN are hosting the semi-annual MPC Users Group (MUG) meeting December 2 & 3. We thank the members of the MUG for their ongoing help and support. - Submission Processing
2020 Oct 13: 21:59. The MPC's submission receipt processing pipeline was down, and submissions were not processed between 12:28 UT and 21:50 UT. The issue has been resolved and all submissions are now being processed. We stress that no submissions were lost, however there will be delays as we process the backlog over the rest of the day. - Minor Planet Circulars
2020 Sept 25: 14:10. We have started preparing the September MPCs, but they will not appear until early October. - Network restored
2020 July 31: 03:30. The network outage experienced starting at 02:10 has been repaired. - Network outage
2020 July 31: 02:10. The Smithsonian experienced a major Internet outage preventing access to most systems and websites. The MPC servers failed-over to back-ups, allowing limited activities to continue. - MPC pipeline
2020 July 21: 03:00. The processing pipeline stalled for approximately 5 hours beginning at around 22 hours UT on July 20. The issue has been resolved and operations are proceeding normally. - MPChecker fixed
2020 July 7: 17:52. Thank you to the many who have alerted us to problems with MPChecker. We have identified and corrected some long-standing issues with the service. Those issues particularly affected dates near the present. - mpo.txt and mpu.txt
2020 July 2: 16:35. The filenames mpo.txt and mpu.txt in /iau/ECS/MPCAT were inadvertently interchanged. It has been corrected. - Web server failover restored
2020 July 2: 00:45. Our web server is back in operation. A problem with Apache has been cleared. - Web server failover
2020 July 1: 23:55. Our web server has failed over to its backup. We are investigating. - AUTOACK resumed
2020 June 22: 04:40. The stall in our AUTOACK procedure has be corrected. It was caused by formatting issues in roving observer submissions. - AUTOACK stalled
2020 June 22: 01:55. We are investigating a stall in our AUTOACK procedure. - Minor Planet Circulars
2020 June 16: 16:32. Larry Wasserman and Andreas Doppler have pointed out a few issues with the ids.txt file associated with the June Minor Planet Circulars. We are working to fix those issues and will indicate when the files have been updated. - Minor Planet Circulars
2020 June 13: 17:31. The June Minor Planet Circulars have been released. - MUG
2020 June 11 & 12. The Minor Planet Center participated in the semiannual MPC Users Group (MUG) meeting. The meeting was held remotely, given the current circumstances. We thank the MUG members and NASA program officers for taking the time to provide their feedback. - BLM
2020 June 10. In support of the movements typified by #ShutDownSTEM, #ShutDownAcademia, and #Strike4BlackLives, the Minor Planet Center limited its work to that which is essential to maintaining safe operations. - Postgres Database Replication Restored
2020 June 07: 14:22. Replication of the Minor Planet Center's postgres database system to PDS/SBN and downstream users was restored in less than a day. We emphasize that the operations of the NEOCP and public access to its data files files were not interrupted. - Postgres Database Replication Suspended
2020 June 05: 18:49. An unexpected disruption in the Minor Planet Center's postgres database system has required us to temporarily suspend its replication to PDS/SBN. In order to correct the problem, PDS/SBN will need to suspend replication to downstream users. We are working on this and hope to resolve the issue quickly. - Minor Planet Circulars
2020 June 05: 13:33. We are preparing the June batch of MPCs. - Minor Planet Circulars
The most recent Minor Planet Circulars were released on 17 May 2020. - Minor Planet Circulars
2020 May 14: 10:53. We are finalizing the next batch of MPCs (April). - Minor Planet Circulars
2020 Apr 13: 16:55. We are preparing the April batch of MPCs. There will be no March MPCs issued. - BepiColombo
2020 Apr 13: 16:54. Peter Veres identified 2020 GL2 = C14VXL1 = BepiColombo. An MPEC retracting MPEC 2020-G96 will be issued. - NEOCP Stall
2020 Mar 24: 17:00. The NEOCP was stalled earlier today. The stall and backlog have been cleared. - Minor Planet Circulars
2020 Feb 12: 14:15. We are preparing the February batch of MPCs. - Minor Planet Supplement
2019 Dec 30: 15:54. We are addressing minor issues in the most recent MPS batch. - Missing comets in MPChecker
2019 Dec 17: 16:45. Thanks to those who have alerted us that some comets, including 2I/Borisov and P/2019 X1 (Pruyne), are missing from MPChecker. We are investigating. - December Minor Planet Circulars
2019 Dec 13: 17:01. The December Minor Planet Circulars were issued earlier today. We are addressing a few consistencies in the products. - Observatory Codes
2019 Dec 11: 15:31. In processing requests for new observatory codes, verifying the precise location of the observatory and evaluating the quality of test observations can be time-consuming. However, these steps are necessary to maintain the quality and integrity of the MPC data collection. The MPC endeavors to process all requests as time permits. We prioritize requests from observatories that will submit large volumes of observations of reliable quality or that will submit crucial, high quality observations. - MPC Users Group
2019 Dec 10: 17:45. Most of the MPC staff members are attending the MPC Users Group meeting in Tucson Dec 10 and 11. Any issues will be attended as time permits. - MPChecker, Asterisks, ObsCodes, Minor Planet Supplements, and December Minor Planet Circulars
2019 Dec 09: 12:55. Five items:
- We are aware that MPChecker has not been accessing the full set of orbits within the MPC catalog, resulting in fewer matches. We have been working to address that issue and to make the system more robust.
- We are also aware of and have corrected instances of missing discovery asterisks.
- With a more streamlined process of evaluating requests for observatory codes, we are steadily getting through the backlog.
- A few minor inconsistencies continue to appear in the weekly Minor Planet Supplements. We are tracking those down.
- The generation of the December Minor Planet Circulars is underway. A larger count of minor planets will be numbered.
- November Minor Planet Circulars and Minor Planet Supplements
2019 Nov 20: 14:20. We are aware of a number of inconsistencies in the November MPCs and MPSs. We are working to trace those to their root cause, while also building in checks into the production software. - NEA.txt and October MPCs
2019 Oct 13: 12:52. The issue with the NEA.txt file has been resolved. We are in the process of generating the October MPCs. We expect this to take a few more days. - Persistent Issues
2019 Oct 12: 12:45. We identified and resolved a problem in a script that was causing a persistent issue in the DOU MPEC. The issue was that a subset of orbits was appearing in every DOU MPEC from Sept 30. We are also aware of an issue with the NEA.txt file and believe it has been caused by a similar script problem. We are investigating. - Scheduled Network Outages: July 27, August 5 and August 7
2019 July 26: 22:20. Our Computation Facility group has informed us that there will be three outages of the networks in the next two weeks, to allow for maintenance. The first is scheduled for Saturday July 27, 13:00-17:00 UTC. The second will be on Monday August 5, 22:00-26:00 UTC. The third will on Wednesday August 7, 11:00-12:00 UTC. During the first two outages, we will need to pause our internal processing routines, as they require access to resources on external networks. No MPECs can be issued during the outages. The issuance of the July 27 DOU MPEC will have be delayed until after the network is restored. We are unsure at this time of whether we have to pause our internal routines for the third outage. We will make an appropriate announcement at a later date. - Minor Planet Supplement and Other Services
2019 July 22: 19:54. A Minor Planet Supplement was issued. All associated data file were released earlier today. This is a significant step toward the complete restoration of MPC services. In addition, the lists of NEOs and Unusual Objects have been restored. We continue to work to restoring all remaining non-functional services. - Minor Planet & Comet Ephemeris Service
2019 July 11: 00:00. There is a problem using the Minor Planet & Comet Ephemeris Service (https://minorplanetcenter.net/iau/MPEph/MPEph.html) for some unnumbered objects. Numbered objects are fine. We are actively investigating this issue.- 22:44. The Minor Planet & Comet Ephemeris Service is back to normal.
- Widespread Power Outage in Cambridge
2019 July 6: 14:30. Yesterday morning the power failed at 60 Garden Street. This was a fairly widespread failue affecting Harvard University and Mt. Auburn hospital. Street power has not yet been restored to the Observatory. However, this outage had no effect on either the internal processing pipeline or the public-facing webpages. - Database Tables and Web Pages
2019 July 2: 19:06. We are aware that some information has not been updated in our publicly-available database tables and web pages since June 5 hardware failure. We are actively working to remedy this. - Orbit Duplication Issue in MPCORB.DAT
2019 June 28: 20:03. The issue of duplicate entries in the MPCORB.DAT file has been resolved, and another DOU MPEC has been issued. - Orbit Duplication Issue in MPCORB.DAT
2019 June 28: 15:20. We were alerted to the presence of duplicate entries in the MPCORB.DAT file. We are working to fix those problems. Another DOU MPEC will be issued within a few hours. - Comet Designation MPECs
2019 June 24: 16:20. Release of MPECs for comets currently on the PCCP has been re-established. We are in the process of clearing the backlog of candidates on the PCCP. Thank you for your patience. - Website Failover Reverted
2019 June 20: 14:06. The problem with the web server request queue has been cleared, and the failover has been reverted back to the primary site. Website Failover
2019 June 20: 12:56. The MPC web server request queue stalled. As a result, the site failed over to our backup server. Processing of observations submitted via curl or web form was delayed.- NEO Designation MPECs II
2019 June 16: 22:09. Release of MPECs for NEOs currently on the NEOCP has been re-established. We are aware that the links to earlier and later circulars are missing; that will be remedied soon.- NEO Designation MPECs
2019 June 14: 16:01. We are continuing to work to re-establish the remaining MPEC processes. We are now beta-testing the designation of non-NEO and NEO objects currently on the NEOCP. We anticipate that the release of MPECs for NEOs currently on the NEOCP will take place over the course of June 14th and June 15th. Your continued patience is appreciated.- DOU and Recovery MPECs
2019 June 13: 16:32. Regular issuance of DOU MPECs and recovery MPECs has been restored. We are working as quickly as possible to re-establish the remaining MPEC processes under linux. This includes MPECs designating new objects. Your patience is appreciated.- Disk Failure at CDP
2019 June 10: 15:00. A failure of the cooling system in the computer room at CDP this past Wednesday evening caused a disk failure on a machine that handles several observation processing pipelines. We have recovered the disk contents from backup and are working to restore affected services. We expect to resume publication of DOU MPECs and related data products within the next few hours, with other MPECs to soon follow. We apologize for this major disruption and will update this status page as services are restored.- No MPCs at the February Full Moon
2019 February 19: 17:27. There will be no batch of Minor Planet Circulars issued at the Full Moon in February. Mid-month batches of MPS will continue to be issued as normal.- DNS Problem Overnight
2019 February 14: 20:00. Last night around 07:40 UTC, the main MPC website failed over to the backup site. From reports, it seems that users may have had access problems as early as 05:50 UTC. The website did not revert back. Around 11:00 UTC, we confirmed that the webserver was still up and had not crashed. After some digging around, we restarted Apache, which restored access to the primary site. We will see if we can determine why Apache failed.- DNS Problem Overnight
2019 January 26: 20:00. Last night around 09:50 UTC, the main MPC website failed over to the backup site. Around 09:55, it reverted back to the main site, then failed over almost immediately. At 10:00, it again reverted to the main site. The rapid fail/return caused some DNS servers to not update correctly. The upshot was that some outside users saw the main site, some saw the backup site and others could not see any site. We reported this problem to the domain registration company and they triggered an update to DNS that seems to have cleared the issue. All outside sites should now be seeing the main MPC site.- Hardware Problem at CDP
2019 January 24: 11:21. Two of the machines at CDP rebooted overnight. One came back online, the other did not. We are heading over to CDP to investigate.- 14:54. Nearly-normal service has been resumed. The problem at CDP was that the AC unit failed in the computer room. The temperature soared from the low 60s F to at least 105 F. The machine that did not restart automatically has gone into a "safe mode", and we can't yet get it out of that mode to reboot it.
- No MPCs at the January Full Moon
2019 January 24: 11:20. There will be no batch of Minor Planet Circulars issued at the Full Moon in January. Mid-month batches of MPS will continue to be issued as normal.- No MPCs at the December Full Moon
2018 December 22: 15:13. There will be no batch of Minor Planet Circulars issued at the Full Moon in December. Mid-month batches of MPS will continue to be issued as normal.- No MPCs at the November Full Moon
2018 November 25: 15:13. There will be no batch of Minor Planet Circulars issued at the Full Moon in November. Mid-month batches of MPS will continue to be issued as normal.- No MPCs at the July and August Full Moons
2018 July 30: 15:13. There will be no batches of Minor Planet Circulars issued at the Full Moons in July and August. Mid-month batches of MPS will continue to be issued as normal.- No MPCs at the June Full Moon
2018 June 24: 15:13. There will be no batch of Minor Planet Circulars issued at the Full Moon in June. Mid-month batches of MPS will continue to be issued as normal. A special names-only batch of MPCs will be issued after Full Moon.- AUTOACK
2018 May 9: 11:10. We are investigating a stall in our AUTOACK procedure. This is preventing ACKs being sent and may impact today's DOU MPEC.- 11:20. This appears to be a repeat of the Jan. 8 problem. The disk on which the queue manager was storing its data was again almost full. Some space has been cleared and the queue manager has again resumed operation.
- MPEC 2018-F73
2018 March 21: 15:40. Due to a connection problem during preparation of last night's DOU MPEC, that MPEC was given the wrong number. It should have been circular F72, not F73. The number has been corrected on the website.- AUTOACK
2018 February 10: 01:20. A submission of a large batch of observations that contains a huge number of repeats of earlier-submitted observations has shown up an inefficiency in the way AUTOACK removes such repeats for such large batches. This is preventing AUTOACK from processing later-submitted block (anything submitted after Feb. 9 20:43). The offending routine will be recoded to make it much more efficient,- 01:34. The job has just finished running. Normal ACKs should resume.
- AUTOACK
2018 January 10: 12:26. We are investigating a stall in our AUTOACK procedure. This is preventing ACKs being sent and may impact today's DOU MPEC.- 13:45. We found that the disk on which the queue manager was storing its data was almost full. There is a safety feature in the OS that pauses the queue manager if this disk space is low. We did some purging of old versions of files and deletion of old files and after releasing only a few MB of disk space the queue manager resumed operation. The DOU MPEC is being prepared.
- No MPCs at the first January Full Moon
2017 December 27: 20:40. There will be no batch of Minor Planet Circulars issued at the first Full Moon in January. Mid-month batches of MPS will continue to be issued as normal.- Temporary Pausing of AUTOACK
2017 December 23: 02:15. We have paused (hopefully, temporarily) the AUTOACK process to troubleshoot a failure of our Linux-based id-checking routine.- 03:35. AUTOACK has been restarted.
- https: on minorplanetcenter.net
2017 December 11: 18:00. As announced on MPEC 2017-X05 we have switched minorplanetcenter.net from using http: to https:. The site has HTTP Secure Transport Security enabled, so any existing bookmarks to http: URLs will be automagically converted to https:. We are currently modifying a number of cgi scripts that need tweaks to disable a warning message about insecure content (it is fine to just ignore those messages), but otherwise we believe the site to be fully functional. If you find something to be non-functional, please let us know at mpc@cfa.harvard.edu.- https: on minorplanetcenter.net
2017 October 30: 18:30. We have switched minorplanetcenter.net from using http: to https:. The site has HTTP Secure Transport Security enabled, so any existing bookmarks to http: URLs will be automagically converted to https:. We are currently modifying a number of cgi scripts that need tweaks to disable a warning message, but otherwise we believe the site to be fully functional. If you find something to be non-functional, please let us know at mpc@cfa.harvard.edu.- 22:10. We are about to switch back to http:, due to an issue with too-old SSL software at another institution.
- Web site glitch
2017 October 29: 21:10. A test of requiring https: (instead of http:) access to minorplanetcenter.net caused a problem which lost the page headers and made scripts non-functional. The changes have been reverted and normalcy should have returned.- AUTOACK Stall
2017 October 23: 07:06. A malformed batch of observations from a satellite caused a routine within AUTOACK to loop. The loop has been cleared and normal operation resumed.- Temporary Pausing of AUTOACK
2017 October 7: 18:33. We have paused AUTOACK as one of the filing updates associated with the October batch of Minor Planet Circulars is causing certain AUTOACK processes to fail. AUTOACK will be restarted as soon as possible.- October 8: 04:46. AUTOACK was restarted.
- Temporary Pausing of AUTOACK
2017 September 11: 18:33. We have paused AUTOACK in order to upgrade one of our Rocks clusters (the one that handles the bulk of the checking and computation jobs).- Temporary Pausing of AUTOACK
2017 September 7: 19:00. We have paused AUTOACK in order to track down a problem with one of our Rocks clusters (the one that handles the bulk of the checking and computation jobs).- 20:00. AUTOACK was restarted.
- No MPCs in September
2017 September 4: 18:30. There will be no batch of Minor Planet Circulars issued at the September Full Moon, as we are busy working on the new observation processing pipeline and other ADES-related matters. Mid-month MPS batches will continue to be issued as normal.- Temporary Pausing of AUTOACK
2017 August 18: 14:18. We have paused AUTOACK in order to track down a problem with the Rocks head node failing to despatch compute jobs.- 14:53. Head node has been rebooted and AUTOACK restarted.
- No MPCs in August
2017 August 4: 12:00. There will be no batch of Minor Planet Circulars issued at the August Full Moon. Mid-month MPS batches will continue to be issued as normal.- Remailing of old MPECs
2017 July 5: 23:50. We have had to move the mailing of MPECs to a different machine while we investigate an issue with an altered mail configuration. The new machine had some old MPECs lying around in the "to be mailed" directory and they have been sent out to some recipients.- Reissuance of MPECs 2017-M13 onwards
2017 June 18: 19:37. MPECs 2017-M13 are missing subject lines. This is causing problems with some mail systems. We will reissue the affected circulars.- Temporary Pausing of AUTOACK
2017 June 10: 12:36. We have paused AUTOACK in order to track down a problem with one of the automated routines.- 18:41. AUTOACK has been unpaused.
- Scheduled Power Outage at CDP April 13
2017 April 12: 16:00. There will be another scheduled power outage at CDP on April 14 from 22:00 to 24:00 (this is related to the earlier scheduled power outages). We will pause AUTOACK around 20:00 and the CDP machines will be shut down around 21:45. The webservices, hosted at the Smithsonian Data Center in Herndon, VA, will continue to operate during this power outage.- April 14: 11:00. Power was restored to the building around 01:00, with the UPS being brought back up around 01:15. All MPC processes restarted normally. AUTOACK was restarted around 02:00.
- AUTOACK, DOU MPEC and April MPCs
2017 April 8: 11:20. There is an issue with the head node of one of our Rocks clusters which is preventing AUTOACK from working properly. We have paused AUTOACK until the situation is resolved. The DOU MPEC is also delayed as its generation also requires the correct function of the head node.- 12:45. The new NEO candidates and observations of NEOCP objects are being processed manually, as they were handled in days of yore.
- April 9: 15:00. The issue remains unresolved. Normal service will be resumed as soon as possible. The preparation of the April MPCs is being abandoned. A mini-MPC batch containing new names of minor planet will be issued in the near future.
- 22:30. AUTOACK was restarted a short while ago. The backlog of ACK messages have been sent (fortunately, this problem occurred during our quiet time). Automatic processing of NEOCP and new NEO batches should resume shortly, but we have to remove from the processing pipeline those observations that were handled manually. We aim to have the DOU MPEC issued tomorrow, though it will be issued later than normal.
- April 10: Some semblance of normality was achieved, certainly enough for urgent operations to continue.
- April 14: 11:00. The original posting of the mini-MPC batch was removed late last night when it was realized that it was the wrong batch. The correct batch has just been put on-line.
- New Numberings in March MPCs
2017 March 13: 14.00. Somehow the new numbers did not get onto the numbering summary in the Minor Planet Circulars. The numbers are present in the Minor Planet Orbit Supplement, which is where the formal numbering occurs. The PDF of the MPC batch may be fixed. The on-line lists of discovery circumstances is being fixed.- 14:50. The on-line lists have been fixed.
- 15:25. The PDF of the MPC batch has been fixed.
- March 14: 12:00. This issue also seems to affect the prov des -> numbered des converter in the MPES. The easiest fix for this is to regenerate the necesssary files in the next MPCs. Users should enter the numbered designations in the meantime.
- Problem with MPChecker file
2017 March 12: 21.00. The data files used by the MPChecker service do not extend to current dates due to a problem with their generation. The necessary files are being regenerated, but it will take a while to get them fixed.- March 13: 14:50. The fixing of this problem required completion of a post-DOU-MPEC task. This seems to have completed and normalcy has been restored.
- Reboot of Web Server (Mar. 7)
2017 March 6: 02:40. We have been informed that the Herndon Data Center will be installing OS patches and rebooting our webserver around 15:00 UTC on March 6. Downtime should be only a few minutes. Automatic failover to a backup webserver should occur if the downtime is longer than ten minutes.- 14:30. We have been informed that this has been delayed until March 7, presumably at the same time.
- March 7: 15:15. The reboot occurred without incident. No failover was necessary.
- No MPCs in February
2017 February 14: 00:00. There will be no batch of Minor Planet Circulars issued at the February Full Moon. Mid-month MPS batches will continue to be issued as normal. A mini-MPC batch, containing errata and new names of minor planets was issued on February 12.- Temporary Pausing of AUTOACK
2017 January 27: 01:20. We have paused AUTOACK in order to track down a problem with one of our Rocks clusters.- 02:20. AUTOACK was resumed. We will need to pause it again tomorrow to further investigate the problem.
- Reboot of Web Server (Jan. 5)
2017 January 4: 18:10. We have been informed that the Herndon Data Center will be installing OS patches and rebooting our webserver between 11:30 and 13:00 UTC on Jan. 5. Downtime should be only a few minutes. Automatic failover to a backup webserver should occur if the downtime is longer than ten minutes.- No MPCs in December
2016 December 11: 15:00. There will be no batch of Minor Planet Circulars issued at the December Full Moon, due to staff vacations. Mid-month MPS batches will continue to be issued as normal.- Problem With Linux Box
2016 December 4: 02:20. One of the Linux boxes at CDP is acting up. It is still responding to pings, but attempts to connect to the box via ssh/sftp are failing. This is stalling our processing pipeline, including acknowledging of incoming batches. We are investigating. We can manually handle incoming NEOCP batches to ensure that service remains active.- 03:25. The affected system was rebooted. The stalled pipeline processes resumed automatically.
- Termporary Pausing of AUTOACK
2016 November 26: 22.30. We will pausing AUTOACK for one to two hours starting at 22:50, to allow us to do a clean sync of DBs at the Herndon Data Center.- November 27: 00:02. AUTOACK has been restarted.
- No DOU MPEC October 28
2016 October 28: 15.00. The October 28 DOU MPEC has been abandoned.- Scheduled Power Outage at CDP October 27
2016 October 27: 17:45. The power outage at CDP has now been shifted to 00:00-02:00 on October 28. The processing pipeline will be paused around 22:15, with power down of the pipeline machines by 23:50.- 22:15. AUTOACK has been shutdown.
- Oct. 28: 01:00. Power has been restored. No network connection to outside world.
- 02:00. UPS restored, so powering on processing pipeline machines.
- 02:30. Internal networking is fine, network to outside still out.
- 05:30. Harvard NOC on site to check their switch connecting CDP to the outside world. Verdict: switch is dead.
- 06:40. Replacement switch on-site and installed. Connectivity to the outside world restored.
- 07:20. AUTOACK has been restarted.
- 07:55. It may take a while for GMail to reattempt delivery of emails that failed to be delivered during the extended outage.
- Scheduled Power Outage at CDP October 27
2016 October 25: 14:00. We have been informed that there is a planned power outage at the CDP complex between 22:00 and 24:00 UTC on October 27 (see the June 2 status message below, the only one of several planned dates for this work to have been made public).- The website will not be affected since it is now hosted in Herndon, VA.
- The processing pipeline machines are still at CDP, so they will need to be shut down around 21:00 UTC.
- They will be restarted as soon as we get the "all clear" following power restoration.
- No ACKs will be sent during this period.
- Lightcurve DB Problem
2016 October 25: 14:00. The lightcurve tables in the DB necessary for the lightcurve pages to function seem to have disappered (or they were not copied over from the backup webserver machine during the Big Move). This will be fixed- No MPCs in October
2016 October 19: 10:00. There will be no batch of Minor Planet Circulars issued at the October Full Moon, due to staff attendence at meetings.- Temporary Suspension of AUTAOCK (October 6)
2016 October 6: 19:38. We will be pausing AUTOACK for a period of about 70 minutes starting at 23:50 UTC today. This pause is necessary to allow network switches at CDP to be upgraded. No ACKs will be issued during this period. The website, now hosted at Herndon Data Center, VA, will not be affected by this outage.- Move of MPC Webserver to New Host Site (Part V)
2016 September 29: 19:50. We apologise for the sending of erroneous MPECs (labeled as being circulars that were not delivered because of the problems detailed below but containing the material from MPEC 2016-S94). The problem has been fixed and the correct MPECs are now being sent out.- Move of MPC Webserver to New Host Site (Part IV)
2016 September 29: 16:00. We believe the issue with sending e-mail is resolved. If the next special MPEC is received correctly by our personal e-mail accounts, we will resend all the non-mailed issues.Please note that circulars will appear to come from mpec@si.edu. If you file incoming e-mail by the From: line, please adjust your filters appropriately.
- Move of MPC Webserver to New Host Site (Part III)
2016 September 25: 15:50. The changeover has, in general terms, gone well. However, users have reported the following problems since yesterday:- MPCORB.DAT not updating -- FIXED
- Daily NEA orbits not updating -- FIXED
- MPECs not e-mailing -- FIXED
- New Sky Coverage files are not being added -- FIXED
- Data and index files for the unnumbered minor planet orbits are out of sync -- FIXED
- Move of MPC Webserver to New Host Site (Part II)
2016 September 22: 17:40. The issues that caused us to abandon last week's attempt to switch over to the new primary website have been resolved. The switch has been rescheduled for 13:00 UTC on Sept. 23. The processing of new observation batches will be paused during this transition, but the web site should remain visible and active throughout. Since we need to do a clean sync between the DBs on the mirror webserver and the new webserver, we estimate this changeover (including transferring many tens of GBs of data across a shared Gb link) will take approximately ten hours. You will know when you are accessing the new site as the top graphic banner will not contain the text "Mirror Site", as it displays currently.- September 23: 12:57. AUTOACK has been paused.
- 13:13. The DB dump on the mirror site has begun.
- 14:14. The copy of the dump file down to Herndon has begun.
- 17:32. The restore of the DB on the new webserver has begun.
- 21:07. The new host for the MPC website is on-line. If you are still seeing "Mirror site" in the top graphic, then your ISP's DNS has not updated yet.
- 21:20. Note that variant orbits and residual blocks have not yet been copied. A note will appear here when they have been.
- 21:30. We do need to a little more testing before restarting AUTOACK.
- 21:31. Please report any problems to mpc@cfa.
- September 24: 02:00. AUTOACK has been restarted. Some lingering issues are being cleared.
- Move of MPC Webserver to New Host Site
2016 September 16: 15:30. The transition to the new host site for the primary MPC webserver will begin around 16:30 UTC. The processing of new observation batches will be paused during this transition, but the web site should remain visible and active throughout. Since we need to do clean sync between the DBs on the mirror webserver and the new webserver, we estimate this changeover will take approximately three hours.- September 17: 03:00. Some serious issues have arisen that have forced us to abandon the planned switchover. We will try again next week. We are restarting AUTOACK.
- No MPCs in September and New Host Site for MPC Webserver
2016 September 13: 13:00. There will be no batch of Minor Planet Circulars issued at the September Full Moon. This is due to several reasons, the primary one of which is the impending move of the primary MPC webserver from machines located at CDP to new machines located at the SI computing center in Herndon, VA. When we make this move we will need to pause the automated processes, to ensure that a clean sync of EPS to Herndon can be performed. This may take several hours, and it is advantageous if we are not constrained in when we can undertake this task and if we do it when observational activity is light. Publishing a monthly batch of MPCs would restrict severely the times when we could do the move, which we hope to do this week. The website (currently running off the mirror site at EPS) will remain accessible at all times.- Brief Webserver Outage
2016 September 5: 02:25. Around 01:50 UTC, the backup webserver stopped responding to requests. The Apache process seems to have died. Attempts to restart it were unsuccessful, so the system was rebooted.- Pause in AUTOACK Part II + Webserver FailOver
2016 August 22: 18:30. AUTOACK is again being paused, potentially for an hour or so, so that we can replace the NIC on the webserver. This will require the webserver to be rebooted. The MPC website should failover to the backup site.- 19:30. Some DNS apparently were still caching the "old" IP address for the webserver. Those DNS that have accepted the short TTL are seeing the IP address for the backup site. If your DNS is still offering the "old" IP address, you can use the IP address 140.247.105.178.
- 20:30. We may have to run off the backup webserver for some time. Attempts to reboot the webserver with the new NIC are failing due to some incompatability. More specifically, the reboot with the new NIC activated a previously-installed network interface software that is not compatible (!) with the system. We have to track down exactly which bit of software is causing the problem, locate a prior version, then replace the new non-functional software. Unfortunately, the webserver has no network access at the moment.
- 21:30. While www.minorplanetcenter.net has failed over, cgi.minorplanet.net
has not (even though the registration company says that it has). We have
put a fix in to allow the NEOCP to return ephemerides, although additional
fixing will be necessary to get uncertainty maps working.
- Aug. 23: 00:40. Uncertainty maps are again working.
- 21:40. Certain recently added pages to the main site (e.g., circulars) may not be present on the mirror site. Feedback forms are non-functional. If you explictly set cgi.minorplanetcenter.net to point to 140.247.105.178 in your TCPIP package (edit your /etc/hosts file in Linux, TCPIP SET HOST in VMS, no idea in Windows), then full functionality should be restored.
- 22:02. The NEA Observation Planning aid is working again. Note that it is currently only accessible via /iau/mpc.html, not via the pull down menu.
- 22:03. The NIC problem seems to have interefered with the mirroring of the master site to the backup site. An example is the lack of recent MPECs.
- 22:26: The MPECs on the mirror site have been brought up to date.
- Aug. 23: 01:02. AUTOACK has been restarted. We may have to pause it again if we detect problems.
- 19:00. The registration company has fixed the problem that prevented the failover of cgi.minorplanetcenter.net. The "fixes" mentioned above should no longer be necessary.
- Aug. 24: 23:50. We have had to disable AUTOACK temporarily.
- Aug. 25: 00:37. AUTOACK has been restarted.
- Pause in AUTOACK
2016 August 21: 15:15. AUTOACK is being paused, potentially for a few hours, so that we can reconfigure the NIC on the webserver, which has been exhibiting intermittent issues that have really messed up the automated processes. A replacement NIC has been ordered and will be fitted when it arrives.- No DOU MPEC Today
2016 August 20: 12:30. There will be no DOU MPECissued today.- No MPC Batch in July
2016 July 17: 17:00. There will be no MPC batch in July. A mid-month MPS will be issued in a few days.- Sudden Problem With Dynamic MPC Site
2016 July 10: 19:25. For some as-yet-undetermined reason, the dynamic side of the MPC site is down. We are investigating why this has suddenly happened. The static side of the MPC website is still functional, so features such as the MPES, MPChecker and SkyCoverage remain accessible, although links to the MPC DB are non-functional.- 19:29. The dynamic side started working again without us doing anything. We continue to investigate.
- June Minor Planet Circulars
2016 June 21: 10:59. The date on the June 20 batch of Minor Planet Circulars is incorrectly stated as June 5 (the date of the last mid-month MPS batch). This is a cosmetic issue, only.- Planned Power Outage June 4 UT CANCELLED!
2016 June 2: 23:10: We have just been informed that there will a power outage at CDP, where our computers currently reside, which will last for several hours from 00:00 UTC June 4. Before this time, we will force the website onto the backup site, but processing will be shut down from about 19:30 UTC on June 3. Processing will resume as soon as possible after power is restored.- June 3: 02:55. We are exploring the possibility of not having to shut down our current pipeline during this power outage (and running off battery backup). Since the networking components outside our intranet will be powered off, no processing of new batches will be possible, but it will mean that processing can restart as soon as power is restored to the complex.
- June 3: 16:32. The previously-mentioned plan can't be done as the battery backup has to disabled during this electrical work (!). We will have to shutdown AUTOACK at 22:55 UTC. The website will be failed over to the backup site around 23:00 UTC. The electrical work is expected to take 2-3 hours. Normal processing will be resumed as soon as possible after power is restored.
- June 3: 17:34. We have just been informed that this planned outage has been cancelled!
- MPES Problem
2016 May 23: 13:40: It seems the index and the data file for the unnumbered orbits in the MPES have got out of sync. They are being regenerated.- 15:30: The regeneration of the necessary files has completed.
- Network Outage at CPD
2016 April 2: 13:18: Around 02:00 all network connections into and out of CDP failed. This prevented our processing pipeline from receving and processing observations and knocked the website offline. For reasons that are not yet clear, the website did not failover as intended to the mirror site. This visibility problem was alleviated by setting up "round robin" IP addresses to the various minorplanetcenter.net host names, which quickly restored access to our services via the mirror site.It turns out the problem was caused by the failure of a firewall border router. This faulty unit was replaced around 13:00 and normal network connectivity resumed shortly thereafter. The backlog of submitted batches is being cleared.
- Some Incorrect Discovery Details for New Numberings
2016 March 24. Due to a production error, the discovery details for a number of the new numberings in the March 23 batch of MPCs are incorrect. The details will be corrected, hopefully, in the next batch of MPCs.- No DOU MPEC Issued February 24
2016 February 24: 14:30. No DOU MPEC will be issued today, due to delays in filing the material from the Feb. 22 MPCs.- Planned Interruption of MPC Network
2016 February 21: 14:30. We have been informed that the Computation Facility is planning patch installations on the firewall routes used at the CfA's three locations. The work is planned between 18:00 and 19:00 UTC today. We will lose network connectivity between machines outside and inside the CfA network, and the MPC website will be unavailable to outside users.- Failover of cgi.minorplanetcenter.net
2016 February 18: 01:00. The script server cgi.minorplanetcenter.net has fallen over to the mirror site. The web server (which currently shares the same IP address) has not. We have hardcoded the IP address of the main script server into the NEOCP tabular webpage, until such time as the reason for this failover are understood and reversed.- February 18: 03:20. We have reported the failback failure to the domain hosting company. We are awaiting a response. In the meantime, we have set up a rsync to copy the NEOCP files every minute from the main site to the mirror site.
- Sky Coverage Problems
2016 January 24: 23:00. A user pointed out that the Sky Coverage service was failing with "Internal Server Error". We have been investigating but cannot locate the problem. We noticed that a user (possibly in the Orem, UT region of the US) was using curl once a day (presumably via a cron job or similar) to get a sky coverage plot and that was working. We can confirm that direct curl calls to the script are continuing to work, but we do not know why that should be the case when the web interface is failing. We continue to investigate.- January 26: 10:43. The Sky Coverage suddenly started working again. We have no idea why it started working again. If you find it not working again, please alert us immediately.
- No Minor Planet Circulars in January
2016 January 21: 22:10. There will be no batch of Minor Planet Circulars issued in January, due to concerns about a possible snow storm and the after-effects of a water main break at the observatory that may require interruptions in the internal network in the coming days.- Incomplete File of Complete Numbered Minor Planet Observations
2015 December 28: 21:30. It seems that the complete numbereed minor-planet observation file is missing objects with numbers above 430000. The file is being regenerated.- 22:55. The file has been regenerated and has been copied to the webserver.
- Changes in Some URLs
2015 November 5: 12.40. Over the next day or so, a couple of URLs will be changed. Automatic redirects will be put in place so that existing links on remote sites should be unaffected. Currently, the pages that will have new locations are the Distant Artificial Satellites Observation page and the list of PHAs.- Problems Accessing the MPC Site
2015 October 25: 14:00. A number of users (initially, all the U.S., but now around the world) have reported that they cannot access the MPC website. A number of users have supplied traceroute output, all of which seem to show that the problem is a router/switch in the Harvard network. We have escalated this the Computation Facility.- File of Isolated Tracklets Location Moved
2015 October 22: 17:00. The file of unlinked/unverified observations, known as Isolated Tracklets, has moved location and changed name. The file is now known as itf.txt. A link to the zipped version is available, as before, on the MPCAT-OBS page. If you have scripts that download this file automatically, you will need to modify them.- Duplicate Entries in MPCORB.DAT file
2015 October 12: 17:39. The problem of duplicate entries appearing in the MPCORB.DAT file appears to have been fixed. The problem was due to the fact that the default behavior for the Linux sort command is a case-insensitive sort. The script that rebuilds the MPCORB.DAT at the start of the MPC month was lacking the command-line incantation necessary to make the sort case senititive. The nightly rebuild script had the necessary line. It has been added to the monthly build script and MPCORB.DAT has been rebuilt. Let us know if problems remain.- AUTOACK Paused
2015 October 1: 20:27. We have paused the AUTOACK while we investigate a severe memory leak on our Linux compute cluster. The head node of our Rocks cluster (24 GB RAM) keeps running out of memory for no apparent reason. Until AUTOACK is restarted, no ACKs will sent out.- October 2: 01:00. The memory problem apparently cleared itself, so we restarted AUTOACK, but the problem quickly resurfaced. We will have to examine this in the office tomorrow, so AUTOACK and various internal processes will have to be stalled until then. There will therefore be no DOU MPEC issued on Friday, October 2. This problem is also delaying the final preparation tasks and issuance of the Sept. 28 MPCs.
- 10:40. On our way into the office this morning, we will stop by CDP and shift compute nodes to a new head node. In the meantime, AUTOACK has been restarted, but will need to be shut down when the nodes are transferred.
- October 3: 13:00. We have identified the why the problem has been occurring and have fixed it. The problem was related to a shell invoked by a single user. What we don't understand is why this problem suddenly appeared a few days ago, as no patches have been installed recently. The MPC post-filing tasks can now continue and the Sept. 28 MPCs will appear as soon as possible.
- DB Search by Obscode Disabled
2015 September 20: 20:00. The DB search feature allowing extraction of observations within certain dates, optionally by a specific observatory code, has been disabled. There have been many instances of users requesting all observations made by the most prolific observatory codes, sometimes two identical requests at the same time. This attempt to download millions of observations, ordered by date, is grossly inefficient and clogs up our server, causing our web service to fail over to the mirror site since the IP monitor does not receive a timely response to its requests.- Complete Observation Files
2015 September 2: 10:15. The complete observation files appear to be missing from the MPCAT-OBS service. We are investigating.- The .gz files appear not to have been copied from the machine where they are prepared to the webserver. They are being copied now.
- MPEC 2015-P11
2015 August 8: 20:57. Due to a problem with access to a shared resource during the production of a recovery MPEC, the process stalled and caused the following DOU MPEC to have the same number. The simplest method to fix this is to retain the DOU MPEC as 2015-P11 and rename the recovery MPEC as 2015-P15. These changes have been made.- Temporary Disabling of AUTOACK
2015 July 27: 15:12. We have temporarily disabled AUTOACK to invesigate a problem with one of our machines in the Rocks cluster. We restarted AUTOACK a short time later.- MPChecker Problem
2015 July 16: 23:00. Starting around 10:00 UTC today, calls to the MPChecker script have been failing with the dreaded "Internal Server Error" message. We are investigating.- July 17: 00:13. We believe we have located the problem and put a fix in place. It is worth remarking that ten hours elapsed from the problem's first appearance to the receipt of the first e-mail notifying us that there was a problem.
- Rejected Name Proposals
2015 July 6: 10:50. A large number of rejection notices for new name proposals have been sent out. A number of rejected proposals were submitted before the introduction of the web interface, so the system does not have the proposal associated with the e-mail address of the proposer. Since they will not receive the rejection message, the list of objects with rejected proposals is given here: (12582); (29449); (168234); (186499); (278141); (341413); and (365758).- Missing Editorial Notice on July MPCs
2015 July 5: 14:50. We have just noticed that the Editorial Notice on MPC 94395 is missing. The missing text is given here: "There will be no batch of these circulars issued at the late July Full Moon, due to staff attendance at the IAU General Assembly. Mid-month batches will continue to be issued as normal."- Harvard Mail Server Blocking MPECs
2015 May 21: 02:00. We have determined that the e-mailing of recent MPECs is being blocked by the Harvard mail hub, which has decided that we spamming! This is not the first time they have blocked us. We have put in a request to have the block removed.- 14:30. The block has been removed. We have remailed circular K26 through K34.
- No Minor Planet Circulars in May
2015 April 10: 13:26. There will be no batch of Minor Planet Circulars issued in May due to the NASA Review of the MPC.- Cfa Network Outage Scheduled for April 5
2015 March 27: 20:08. We have been informed that the Computation Facility will be upgrading the network firewall at CDP on April 5, between 17:00 UTC and 21:00 UTC. We will have no connection to the outside world during this upgrade. Web services at CDP will not be available, but the mirror site at Harvard EPS should be functional. We aim to have automatic failover for the website active before April 5, so the use of the mirror should be transparent to users (as long as you refer to the site via the hostname...).- March 30: 17:10. We are temporarily disabling the AutoAck procedure in order to reconfigure some machines to ease the upcoming network outage.
- 18:47. AutoAck has been restarted.
- April 5: 01:15. Automatic failover for minorplanetcenter.net should be functional. We will pause automated processes starting around 16:30 UTC.
- Repeated MPEC 2015-F31
2015 March 19: 22:45. It seems that two MPECs were issued with the same circular number. This shouldn't happen, and it is unclear at the moment why it did happen. MPEC 2015-F31 is a new comet discovery and -F32 is a new NEO discovery. The versions on the web have been fixed.- Cfa Network Outage Scheduled for March 23-24
2015 March 10: 17:00. We have been informed that the Computation Facility will be upgrading the CfA network firewall on March 23-24, between 17:00 UTC and 01:00 UTC. We do not yet know if this means that the MPC webservers will be unavailable. We do know that we will have no access into our machines from outside, neither will we be able to update the website.- Temporary Disabling of AUTOACK
2015 March 7: 00:45. We have had to temporarily disable AUTOACK to fix a problem with the checking routines that are run on batches of unidentified observations. We restarted AUTOACK sometime later.- Restrictions on Downloading Files
2015 February 25: 17:00. There are many users who download at intervals of minutes or seconds files that are changed only daily (or less frequently). The sheer number of such users is causing significant (and unnecessary) load on our servers. We have therefore implemented a scheme by which only one download of each file per 12 hours is permitted per IP address. Subsequent attempts to download the same file within 12 hours will return a blank file (unless the file in question has been updated since the last attempt). Due to the way that the scheme works, an aborted download will trigger the 12-hour block.We have temporarily disabled this feature. It will return in a somewhat modified form in the near future.
- How do I tell if I'm downloading a file subject to restrictions? When you click on a link to get a file, if the URL is redirected to /download/transfer, then that file is subject to download restrictions described above.
- Although we will over time expand the number of files subject to download restriction, we do not plan to do this for the NEOCP files.
- If you believe that you are being blocked incorrectly, send a message to mpc@cfa stating the name of the file you are trying to access and the IP address of your machine (be sure that the IP address you give is an externally-visible address).
- Possible AUTOACK Delays
2015 February 9: 18:00. Some 24 very large observation batches are currently working their way through the AUTOACK pipeline and this is delaying the sending of acknowledgements. The backlog will be cleared after these very large batches finish processing.- ECS Problem
2015 January 7: 18:31. A user has pointed out that the files associated with the Jan. 7 batch of Minor Planet Circulars are actually last month's files. An investigation has shown that the copying of those files to the last month directory worked, but then the copying of the new files failed because the files from last month were still present in the current month directory. This procedure worked last month (and before), so it is unclear why the behavior changed when the copying procedure was not altered.-
19:35. We believe the problem with the MPCUPDATE files to be fixed. Please report
any anomalies to mpc@cfa in the normal fashion. We do not yet understand why the process
failed, other than suspecting that the syncing with the mirror site during the December
problems messed things up. We will keep an eye on the process next month.
- Incorrect Discovery Details in the January Minor Planet Circulars
2015 January 7: 15:00. There are an (as yet unknown) number of incorrect discovery details for numbered minor planets, that should be covered by the MPEC 2010-U20, in the January batch of Minor Planet Circulars. This error is most perplexing as the bulk of the new numberings were entered in one operation on Dec. 27 and there are examples of both correctly-assigned and incorrectly-assigned details in objects inserted at that time. Either they should all be correct, or they should all be incorrect--hence our perplexion. Corrected details will appear in the Feb. Minor Planet Circulars. No name proposals will be accepted for objects with numbers between (415689) and (422636), inclusive, until this is resolved. Any such proposals that appear on the CSBN website will simply be deleted.- 15:47. We now know why the misassignment occurred. The previous version of file of designations that were grandfathered into the old discovery assigment scheme was dated 2011 June 4. The latest version was dated 2014 July 11 and contains 207 designations that are later than the changeover date. The date suggests that the change occurred around the time of the preparation of a batch of MPCs, but it is difficult to see how the erroneous additions could have been added as the file is only read by the numbering procedure, never written. More problematic is that some grandfathered objects may have been subjected to the new rules. We are checking into that. A check is being added to the numbering process to ensure that the creation date of the latest version of the file is not after "14-JUN-2011 14:45:02.88".
- January 28: 16:30. Unfortunately, the corrected details will not be ready for the Feb. Minor Planet Circulars. We will endeavor to get them sorted out for the March circulars.
- No Minor Planet Circulars in December
2014 December 6: 20:00. There will be no batch of Minor Planet Circulars issued in December.- Minor Change in NEOCP Posting Criterion
2014 December 5: 17:45. The digest2 score necessary for a new potential NEO candidate to be posted to the NEOCP has been raised from 50 to 65.- Problems with CF DMZ
2014 November 29: 22:00. At some point this afternoon, the website went down. After some investigation, we believe the problem to be not with our webserver machine, but rather with the Computation Facility's DMZ in which the websever resides. We can access the webserver from other machines within the DMZ, but not from any machine outside.- We have switched the mpc.cfa.harvard.edu address over to the mirror site. The website will remain on the mirror site until the DMZ problem is fixed. This change should be transparent to outside users.
- The CSBN name submission and member voting pages will have to be disabled until the web site is back on the regular machine.
- The cgi scripts are not functioning on the mirror machine. We are working on fixing this.
- November 30: 02:25. The NEOCP, MPChecker and MPEph should now be functional, with the following caveats: 1) graphical display of NEOCP uncertainties is not functioning (a blank page is returned, we are working on this issue); 2) uncertainty information and residual blocks in the MPEph are not available (the necessary data files do not exist on the mirror site and will not be available until the DMZ problem is fixed). The links to the designations associated with each object and the link to the naming citation are now functional. Other cgi scripts may or may not be functional. Scripts that call cgi.minorplanetcenter.net will fail until such time as the CF repoints that host name to the mirror site (IP 140.247.105.178, in case you wish to hardcode an IP address into your scripts).
- Our Linux processing cluster also experienced issues today. We have rebooted the cluster. The issues caused a number of known objects to be posted to the NEOCP--these are being removed.
- A major issue with shifting the cgi scripts over to the mirror site has been the fact that the MPC does not control the cgi.minorplanetcenter.net hostname. We therefore intend to migrate in the short-term to using cgi.minorplanetcenter.net as the hostname for scripts, since we control this hostname. Current cgi.minorplanetcenter.net addresses will continue to work for the foreseeable future, but will not be altered if we need to switch to the mirror site again. Writers of scripts are advised to use cgi.minorplanetcenter.net when writing new scripts and to edit existing scripts.
- The processing cluster has been rebooted to clear problems that have caused extremely sluggish responses. The NEWNEO and NEOCP are being restarted, and the backlog of these types of objects will be then be cleared automatically. Once these are restarted, AUTOACK will be restarted.
- December 1 @ 06:30. Processing cluster is again sluggish. We believe we have identified the problem: a failing SCSI interace on one of the machines host the shadow sets. We are heading back in to CDP to replace the card.
- 07:25. We believe the processing cluster problems to be fixed. NEONEW and NEOCP processing will be back to normal, once the backlog is cleared. AUTOACK is functional. Processing of non-urgent observations (e.g, MBAs) will be restarted tomorrow (erm, later today...).
- Unexpected Machine Reboot Overnight
2014 November 25: 21:00. Early this morning, one of our cluster machines rebooted unexpectedly. Upon reboot, other machines in the cluster failed to remount one of the hosted shadow set disks. This stalled processing. A dirty cluster reboot had to be performed. NEO-related processes were brought back first. Some less urgent processes remain to be restarted. If you think a batch you submitted today has not been processed, please contact us. You should only resubmit if we ask you to.- Suspension of ACKs
2014 November 19: 18:55. The AUTOACK process has been suspended while we investigate an odd problem with the compute cluster. E-mails sent to obs@cfa will be ACKed once we figure out the problem.- 21:01. AUTOACK has been restarted.
- Suspension of ACKs
2014 October 30: 16:00. The AUTOACK process has been suspended, so that we can set up master-slave replication of our DBs with a remote system. We anticipate that this will take about two hours. All web services should continue to operate normally during this suspension.- 17:18. DB setup has completed. AUTOACK has been restarted.
- Missing Information in MPES
2014 October 17: 01:39. It turns out that a large-capacity data disk on the webserver failed to mount following the recent power outage. Among other things, the disk contains the residual blocks and the datafiles necessary to generate uncertainty information. We will try and get it mounted as soon as possible.- 14:04. The disk is now mounted. Residual blocks and uncertainty information are again available.
- Power Outage
2014 October 15: 05:27. There was an unplanned power outage in the computer room at CDP on October 14 @ 20:27. All MPC machines were affected. This is a repeat of the problem that caused the March 8 power outage. Power was restored shortly after 24:00. All automated processes have been restarted and the web site appears to be functional. One serious problem remains: no observational e-mail is being delivered to the processing queues. A query has been sent to the Computation Facility to track down why e-mail is not being delivered. Fortunately, e-mail is also delivered to a staff e-mail address, so the observations that have come in since the power outage are being submitted via the cURL route. This is a manual process. Observers are encouraged to use the cURL submission method, at least until the e-mail issue is resolved.- October 15: 07:00. The power failed again in the CDP computer room!
- 10:00. Power was restored. Systems were restarted and the processing pipelines have been (mostly) restarted. It is possible that some observation batches may not have been submitted to the processing queues. If you are lacking an ACK for a batch, you have not received a status message for a new NEO candidate, or a NEO candidate that should have been posted wasn't, please contact us (making sure to mention which batch and designation you are referring to). Do not resend unless we ask to do so.
- MPEC mailing problem
2014 September 22: 23:40. It appears that the mail server we use has decided to flag our MPEC mailings as "suspicious" and is not sending them out. We will try and get this block removed.- September 23: 01:35. We have received reports that NEOCP Blog postings are not being sent to subscribers who have requested e-mail delivery. Posts are appearing on the NEOCP Blog itself.
- 02:25. While we were investigating, the problem with the mail server disappeared and stacked-up e-mail began to be delivered, without us actually changing anything.
- Two MPEC 2014-Q39
2014 August 24: 19:10. Two MPECs, for different objects, were issued with the same MPEC number. The correct 2014-Q39 is the one listing the recovery of P/2005 Q4 (LINEAR), while the recovery MPEC for 2011 ON45 is now 2014-Q40. The web site is being updated with these corrections.- NEOCP Updating Problem
2014 June 25: 00:30. A configuration problem has been causing updates to the NEOCP to fail for the past few hours. The fix for this is being worked on actively.- 06:07. The problems have been fixed and the backlog of new NEO and NEOCP batches has been resubmitted to the processing queues. We believe that all batches have now been processed. Please report any missing NEO/NEOCP observations.
- PDF of 2014 June 13 MPCs Replaced
2014 June 17: 12:30. The PDF of the 2014 June 13 MPCs has been replaced, following an e-mail report that the new numbers were missing from one table in the circulars. There was an issue during the preparation of this batch that caused the numbers to be omitted from certain tables/files. The datafiles in the MPCUPDATE service were fixed earlier.- June 24: 18:00. The file was again replaced to fix a minor issue.
- Known Objects Posting on NEOCP
2014 June 10: 15:40. An over-zealous cron job, designed to purge old files from a directory containing orbital elements for checking purposes, deleted a needed file. Until the check file was replaced, some known objects were posted on the NEOCP. Once the check file was replaced, subsequent follow-up observations were correctly identified. The known objects should now have been removed from the NEOCP.- AUTOACK Issue
2014 June 9: 02:40. In an apparent repeat of the May 29 incident, the communication between two parts of the MPC processing pipeline broke for as-yet-unexplained reasons about an hour ago. The most visible outside effect of this outage is the lack of recent ACKs. We have identified which machine has the problem and a reboot is planned in the next 15 minutes or so.- 03:31. The problem machine was rebooted. Normalcy has returned.
- Backlog of New NEO Processing
2014 May 29: 15:00. The communication between two parts of the MPC processing pipeline broke for as-yet-unexplained reasons late yesterday. This prevented, amongst other less important things, the processing of new NEO candidate batches. The loss of communication was transitory, lasting perhaps 20 minutes, but the effects lingered. The stalled processes have been restarted and the backlog of new NEO batches is being cleared. We are also looking at how to detect this problem as soon it occurs.- MPEC 2014-H31 and Designation 2014 HL4 Abandoned
2014 April 24: 14:44. The fix that was supposed to prevent a repeat of today's problem with duplicate designations and MPECs did not work. The circular for 2014 HL4 has been abandoned (the next circular will use the same number) and the designation 2014 HL4 has been abandoned.- MPEC 2014-H26 and Designation 2014 HF3 Abandoned
2014 April 24: 10:50. Due to a production issue with the recently-implemented fully-automatic preparation and issuance of MPECs, two circulars were issued for the same object under different designations. The circular for 2014 HF3 has been abandoned (the next circular will use the same number) and the designation 2014 HF3 has been abandoned.- Temporary Removal of Further Observation Information in MPES
2014 April 17: 02:35. Following an e-mail report from an outside user about occasional inconsisent information displayed by 'Further Information' between the full and summary output in the MPES, we have temporarily disabled this output. It will return in the near future in an extended form.- May 4: 13:12. The 'Further Information' link has been restored.
- Temporary Outage of AUTOACK
2014 April 16: 22:48. We need to reboot two machines in order to clear a hardware problem with a disk. One of the affected machines is the machine that accepts incoming observations. The exact time of the reboot is not yet known, but it will be soon. ACKs will not be sent out during this reboot process. The total downtime is hoped to be under 30 minutes.- 23:30. The two machine have been rebooted, but an issue with ensuring consistency of the multiple shared disks in the cluster is preventing the machines fully rejoining the cluster. We are on-site and will restart processes as soon as the disk data integrity is ensured.
- April 17: 00:00. The data integrity checks have finished and the two rebooted machines have rejoined the cluster.
- Problem With Uncertainty Map Generation and Sky Coverage Plots
2014 March 20: 12:38. A user has alerted us to the fact that attempts to generate uncertainty maps and sky coverage plots are failing with the dreaded (and completely unhelpful) error message "internal server error". We are investigating why this error has suddenly appeared without any change being made in those processes.- 13:02. The image generation problem is fixed. A security update trashed a softlink needed by the graphics library. A workaround is being put in place to try and prevent this happening again.
- Power Problem in CDP Computer Room
2014 March 8: 15:00. The power has failed in the CDP computer room where the MPC's computers reside.- 18:00. Power has been restored. Website should be back shortly. Restarting processing pipelines will take longer.
- 23:00. Normalcy should now be restored.
- E-Mail Issues
2014 February 27: 15:00. With zero notice, the CF has made a change in the delivery of e-mail addressed to obs@cfa. This change has resulted in no e-mails being delivered to the automated processes. This means that incoming batches are not being ACKed. We are in communication with the CF to get this resolved ASAP or the former behavior of the e-mail sustem restored.Please do not resend observation batches. Any batches that arrived during the "problem" will be forward to obs@cfa when normalcy returns.
- 17:00. Some semblance of normalcy has returned. ACKs are being sent out and automated processes are chugging away. Batches that arrived during the "outage" have been resubmitted.
- February 28: 03:00. There may still be some lingering problems. We are seeing unusual periods of inactivity, where no observation batches come in.
- 04:00. After submitting a batch of observations, if you see a reponse informing you that "some recipients of obs@cfa.harvard.edu might not receive your message" and you received the normal ACK, you can ignore the warning. This is some drivel that Google Mail is spouting and we haven't yet figured out how to turn off this "feature".
- Network Problems
2014 February 18: 17:00. There were major networking issues amongst some of our computers over the past 24 hours. These had a major impact on some internal operations. We believe the bulk of the problems have been resolved. Batches that have not been processed will be resubmitted for processing.- Problem With Uncertainty Map Generation and Sky Coverage Plots
2014 February 9: 22:30. A user has alerted us to the fact that attempts to generate uncertainty maps and sky coverage plots are failing with the dreaded (and completely unhelpful) error message "internal server error". We are investigating why this error has suddenly appeared without any change being made in those processes.- 23:05. The image generation problem is fixed. The setup of a shared NFS directory apparently deleted a soft link that was needed by the graphics library. Why that one soft link, out of many in the directory, affecting an application that has no connection to the NFS shared directory, should have been deleted is unknown.
- NEAObs Problems Mostly Fixed
2014 February 9: 14:00. Recent problems with stale data in the NEAObs service have been resolved. Some more generation of data will be necessary over the next few days, and we are looking at porting the entire procedure that generates the data need onto newer hardware.- Problem With E-Mail Delivery Overnight
2014 January 6: 12:50. The e-mail interface between Google Mail (the e-mail system in use at CfA) and the MPC apparently stopped working between about 05:00 and 10:00 UTC this morning. Essentially no e-mail arrived at the MPC during this period. We have contacted the Computation Facility to try and find out why this happened.- 14:10. The CF is investigating and have shutdown @cfa addresses while they do this check. No word yet on when normal service will resume.
- 16:11. Although we have had no word from the CF yet, observation batches are being delivered without any delays. It is unclear if the backlog of non-delivered messages has been cleared yet.
- Problem with MPEC 2013-Y09
2013 December 18: 21:30. A problem with the filing of the newly-referenced orbits from MPEC 2013-Y09 has been identified. The orbits will be republished on the next DOU MPEC and will be accessible in, e.g., the MPES after that publication.- Website Issue
2013 December 10: 21:50. A problem with the MPC's webserver required us to shut down the server for a while earlier today. When the system was brought back up, access to cgi scripts continued to be disabled for outside sites for a while longer, to allow us to diagnose the issue. The problem has been identified and a fix is in place. Access to cgi scripts has been restored.- DOU MPECs
2013 November 11: 18:00. Automatic issuance of DOU MPECs will be suspended temporarily while we reconfigure the procedure. There will be manual issuance of DOU MPECs at odd time over the next few days.- NEOCP Batch Processing
2013 November 8: 23:00. Due to a recent incident of gross misidentification of an NEOCP object by an observer, NEOCP batches will henceforth be passed through the NEWNEO procedure to try and minimize similar identification problems in the future. Observers will therefore see reports that were previously sent only upon submission of a new NEO report.- NEOCP Problems Overnight
2013 November 7: 15:45. An over-zealous cron job deleting old temporary files ignored the "do not delete this file" protection on the script that generates the variant orbits and deleted it. Needless to say, this confused the NEWNEO procedure and caused newly-reported NEO candidate to not be posted. We have replaced the deleted procedure, modified the delete cron job to be more selective, and resubmitted the batches that failed.- Sluggish Webserver Response
2013 October 28: 13:40. We have received reports that certain web services have been unresponsive or non-function this morning. We have determined that the load on the webserver machine is extremely high, due to a number of sites sending hundreds of requests per minute to our various services. The offending IP addresses have been blocked.- 14:18. Problems persist, so a webserver reboot is being performed.
- Network Problems
2013 October 6: 17:00. There are networking issues amongst some of our computers. These are having a major impact on some internal operations. Replacement of at least one network card is planned for the near future. Issuance of MPECs will be delayed and last night's DOU MPEC has been abandoned.- 21:50. An interface card has been replaced. Processes have been restarted. Various backlogs have been cleared. MPEC T39 is the recovery MPEC for 2009 VA1, not the Oct. 6 DOU MPEC.
- Plotting Issue
2013 August 4: 16:15. We have identified a difference in the environment on the new webserver (which also serves as the cgi server and the DB server) when compared to the old webserver. This difference is causing dynamically-generated plots (and other temporary files) to be written to the wrong directory. This is being fixed.- 18:00. The temporary directory issue has been fixed.
- August 6: 19:00. A (partial) fix for the PNG display of sky coverage charts and uncertainty maps in in place. The sky coverage charts are missing the textual information and the uncertainty-map grids currently show no points. The missing font problem is being looked at.
- August 7: 14:50. Copying the PGPLOT font file from the old app server to the new server, and repointing one environment variable, returned fonts to the images generated by the sky coverage and uncertainty map scripts! The generation of NEOCP uncertainty plots has been moved back to the new server.
- Mail Issues
2013 August 4: 23:13. Four of the cluster machines are experiencing problems with name resolution and e-mail. One machine that was sending email at 21:30 is no longer. The reasons for this are unclear, but it is having an impact on the operation of a number of automated routines. We are investigating.- August 5: 14:00. After attempting to modify the existing configuration, we gave up and reconfigured the TCPIP software from scratch on all our machines. We believe all issues to be fixed.
- Some CGI Issues on the New Web Server
2013 July 31: 00:07. Dynamic image generation, as used in the cgi scripts that return uncertainty maps or sky coverage plots, are currently off-line for two reasons. The first problem was incorrect protection on the temporary directory used to store the images--this is fixed. The other problem is that PGPLOT graphics library is not installed. This is being worked on, but the automatic installation procedure is apparently not working (why am I not surprised...), so the installation may have to be done manually.- 14:00. The PGPLOT library is installed, but the required PNG support is disabled, due to an incompatability between the PGPLOT library and the libpng library used for PNGs. This incompatability occurs on newer versions of the OS. Attempts to switch back to GIF images generated segfaults, so there may be incompatabilities here, too. We are investigating our options.
- Aug. 1: 11:33. We are trying to get the uncertainty maps for NEOCP working on the old app server. This requires a sync between the new and old machines every time the NEOCP is updated. All the necessary processes are written, but there is a protection problem with the sync process. We are trying an alternate approach.
- Aug. 1: 11:50. Textual information on NEOCP uncertainties is still functional, as is PS output of Sky Coverage plots.
- New Web Server
2013 July 29: 21:00. A new look MPC website on a new web server is being brought on-line today. The internal changes necessary to copy material to the new web server machine are complete. The switchover of the DNS records to allow external users transparent access to the new site will be done in about 90 minutes. It may take some hours for the DNS changes to propagate to all DNS servers.- July 30: 00:50. The DNS records were updated around 22:30. The change was visible on home systems within roughly 30 minutes. The DNS record for the alias scully, which points to the script server, has to be updated by the Computation Facility. A request was put in a few hours ago, but it is unknown when the change will be made.
- Physical Move for Some MPC Computers
2013 July 24: 15:30. The MPC computers that remain at 60 Garden Street will be physically moved to CDP late on Thursday, July 25. Automated procedures will be shut down some time prior to the (as yet unknown) move time. An update will appear here when the move is completed.- July 25: 13:45. The automated processes are being shutdown in preparation for the physical move. Patch installation will be performed before the move.
- July 26: 00:30. The patches have been installed, the systems shutdown, transported over to CDP, reconnected, powered up and the cluster has been reformed. Unfortunately, there appears to be a network issue related to the new IP addresses necessitated by the move that prevents our machine talking to any machine outside the cluster. There is nothing we can do to fix the problem. It will require the involvement of the CF and that will not happen before the morning.
- July 26: 20:40. The network problems have been resolved (incorrect configuration information supplied by the CF). We are doing some checking before restarting the automated processing routines.
- July 26: 21:20. It turns out all our key authentications are now broken due to required assignment of new IP addresses. This will need fixing before we can restart any automated processes.
- July 27: 02:00. Automated processes are being restarted.
- July 27: 13.00. Most automated processes are restarted. DOU MPEC should resume tonight.
- Two Incorrect Numbered Orbits
2013 July 24: 15:30. Following a query about non-NEOs being flagged as NEOs, we have determined that the orbits for (103790), published on MPS 266361, and (105071), published on MPS 266365 refer to the numbered objects (363790) and (365071), respectively. The problem arose because both these objects have radar observations and, at the time these orbits were prepared, the radar-orbit preparation routine did not handle designations above (359999) correctly. The radar-orbit preparation routine has been fixed and new orbits will appear on the next DOU MPEC- Planned Power Interruption at CDP
2013 July 8: 19:05. We have been informed that there will be a power outage at CDP on Wednesday, July 10, in order to repair/replace electrical circuit breaker surge protection equipment. This is related to the May 16 issue. Computer systems, including our public-facing systems, will be shutdown starting at 20:30 UTC and power should be restored by 01:00 UTC on July 11.- Web Site Issues
2013 July 3: 12:30. It appears that the MPC webserver is unavailable. A large number of ruby jobs (presumably doing DB updates) are running and this is clogging up the server. The script server (aliased as cgi.minorplanetcenter.net) is working normally. We are investigating.- Misassignment of Minor Planet Names in June
2013 June 26: 12:48. Due to a production error, many of the new names accepted in the June Minor Planet Circulars were assigned to the wrong minor planet. The names will be republished in the July Circulars.- Unexpected Power Interruption May 16
2013 May 16: 16:00. We had one hour's notice that power to the building where part of our computer system resides would be turned off to allow engineering work. We were able to stop the automated processes and dismount the shadow sets, but were unable to stop the machines restarting when power was restored. This uncontrolled power up has caused major problems to the cluster. One machine is off line (service has been called) and one external disk box is not sharing its disks (one member of each of four three-member shadow sets). No data has been lost, but until the affected machine has been repaired, certain internal tasks may be delayed.- One feature that we cannot easily replicate while the off-line machine is unavailable is complete datasets necessary for the various MPChecker facilities. Our internal checking routines are not affected by this problem.
- There is a workaround in place for the MPChecker services. Note that full functionality is not yet back in place as the service is missing the nearby-epoch data for NEOs and the historical data for all objects.
- The May Minor Planet Circulars batch will not be issued.
- Network Interruption May 14
2013 May 14: 16:00. We have been reminded that the main network router at 60 Garden Street will be upgraded during the time period 21:30 UTC on May 14 to 01:30 UTC on May 15. MPC webservices should remain accessible during this network outage, but updating of pages will not be possible due to internal network disruption.- Potential Service Interruptions May 18
2013 May 14: 13:25. We have been informed that Computation Facility services will be unavailable between 13:00 and 18:00 UTC on Saturday, May 18. CF webservices and e-mail service will be unavailable during this period. The MPC webservices (and the updating of data used by the services) should be unaffected by this downtime.- SKYCOV Restored
2013 Apr. 8: 16:26. The SKYCOV service has been restored to full functionality and sky coverage data is again available up to the current date.- SKYCOV and DELCODE Removals
2013 Apr. 6: 01:52. We are now looking at repairing the SKYCOV service. This will also fix the problem of the automatic removal of DELCODE requests. In the meantime, the script that validates DELCODE requests for removal will forward the request to a staff member for removal.- Apr. 7: 13:45. Automated removal of DELCODE requests was reactivated last night. Please report any problems with removals.
- Apr. 7: 15:45. The SKYCOV service is almost restored. Batches of sky coverage are being copied to a temporary directory on the app server. We just need to move those copied files to their final locations and rebuild the catalogue of available files. These tasks will be done tomorrow.
- File Protection Problems on Web Server
2013 Mar. 27: 12:15. Following the updating over the past two nights of various files on the web server machine, it appears that the transfer process has suddenly started disabling world/other read permission on two of the many files that it copies. This is annoying as it prevents the MPES from running. This problem has occurred in the past, for different files over varying periods of time. We are investigating the best way to locate problem files and reset the permissions if found to be wonky.- 12:45. The potential source of the problem has been identified and a fix has been implemented. As to why only two of four transferred files (all unpacked into the same directory) were affected by this problem, we have no idea!
- AUTOACK Problem
2013 Mar. 25: 20:32. The machine that sends out ACKs and processes incoming e-mails is having hardware issues. We are investigating and attempting to move processes to another machine.- Mar. 26: 16:31. A rebuild of the process was required. A functioning version of AUTOACK is now running on another machine. Some recent observations batches have been ACK'ed by this new routine running in test mode. Other observation batches that arrived after Mar. 25 17:16:21 UTC and before March 26, which were processed manually during the outage, will be forwarded to AUTOACK. Observers may receive two (or more) ACKs for messages. A semblence of normalcy has been restored, further work will be necessary to add functionality to the new AUTOACK process.
- Mar. 26: 14:10. The SKYCOV service has also been affected. A partial fix to this problem is forthcoming (accepting of incoming e-mails), but a full fix will have to wait until after the March Minor Planet Circulars are prepared.
- Mar. 26: 20:14. Extensive testing of the new routine showed up some problems, which have all been fixed. Automated ACKs have resumed.
- E-mail Submission of Observations Via mpc@cfa Shut Off
2013 Mar. 4: 13:32. As noted on MPEC 2013-A21, the e-mail address mpc@cfa can no longer be used for submission of observations. E-mail submission of observations must be via obs@cfa. Any future submissions of observations to mpc@cfa will not be acknowledged. The e-mail address mpc@cfa will continue as a general contact address for the MPC.- No Mid-Month MPS Batch
2013 Feb. 8: 23.55. As a direct result of this weekend's major snow storm in New England and the consequent major risk of extended power outages, there will be no mid-month MPS batch issued this weekend.- Problem With MPES
2013 Jan. 30: 15:14. It appears that there is a problem with one (or more) of the data files used by the MPES. We are investigating.- 16:14. The problem with the MPES data files has been located and fixed.
- Intermittent Network Problems
2013 Jan. 9: 22:40. We have received a report from our CF that Harvard is investigating intermittent network connectivity problems. We have already received a report of a script being temporarily inaccessible.- Extended Power Outage at CDP
2013 Jan. 3: 15:01. There was a four-hour power outage at CDP between 07:30 and 11:20 this morning. The website and scripts should again be visible. Internal operations are being restarted as necessary.- 21:10. We have been informed that the power issue this morning fried one of the main electrical power fuses in the computer room. It will be replaced at 22:00 on Monday, January 14. This will require shutting off the power. The downtime is expected to be under 30 minutes, but one hour is the announced timeframe. Website and scripts will be off-line from around 21:30 until power is restored.
- Archive of older enhancements and problems/resolutions
- NEO Designation MPECs II