All questions

Courses · Learning · Accounts

Why do estimated completion dates change?

Answer based onMA StaffWhat does this mean?Last reviewed

Estimated completion dates change due to fluctuations in a student’s performance or pace, as the system estimates remaining XP based on recent performance Source: Other, MA StaffSource: Other, MA Staff. These dates are “typically” recalibrated every few days via a simulation server that runs to account for path dependency and averages Source: Podcast, 01:18:49, Official MASource: Discord, MA Staff.

Historically, staff noted that timelines can slip due to increased pressure from a growing user base Source: Other, MA Staff. Other factors affecting these estimates include the measurement of XP/day per weekday, the need for review on previous course topics Source: Discord, MA Staff, and the requirement to run new simulations when course topics are updated Source: Podcast, 56:47, Official MA.

Timeline

Relevant statements and observations, newest first.

  1. MA Staff — what does this status mean?The Math Academy Way (p. 440)

    “Any fluctuations in performance or pace will affect the completion date, especially at the beginning when you first start out, because the system has to take a "best guess" and then gradually refine the estimates”— Justin Skycak

  2. MA Staff — what does this status mean?The Math Academy Way (pp. 440–441)

    “The completion date is calculated by first estimating how many XP remain in the course based on your recent performance.”— Justin Skycak

  3. Official MA — what does this status mean?Justin Skycak — OpenEd Podcast: The Real Reason Your Kid Hates Math (It’s Not Them)

    “The system recalibrates based on results - if you missed three questions, it gives you review topics for those areas, then a retake with new questions.”— Jason Roberts

  4. MA Staff — what does this status mean?Justin Skycak — Earning the Right to Scale - Math Academy Podcast #7, Part 2

    “when the course gets updated, we’re going to go send an email to everybody who’s in the course with the information. And then we’re going to re-enact, like refresh their. their tasks and their completion date and…”— Justin Skycak

  5. Official MA — what does this status mean?TechZing — 412: TZ Discussion - Bullshit Generator / Bullshit Eliminator

    “the problem is when alex updates a course and adds two or three topics and now we have to write two thousand”— Jason Roberts

  6. MA Staff — what does this status mean?Discord — Justin Skycak / math-for-ml

    “Likely, the previous estimate had gotten out of date and just happened to be refreshed (estimates are typically recalibrated every few days).”— Justin Skycak

  7. MA Staff — what does this status mean?Discord — Justin Skycak / foundation-series

    “A couple factors: 1) XP/day is measured per weekday, and 10500 * 5/7 = 7500 XP 2) You still need to do review on topics from MF1, which would add to the XP metric.”— Justin Skycak

  8. MA Staff — what does this status mean?Justin Skycak — Golden Nuggets Podcast #35: Optimizing learning efficiency at Math Academy

    “We initially had estimated completion dates when we weren’t as prominent, so there wasn’t much pushback if we were a little late. Now that Math Academy has gained more attention, we’re getting a lot more pressure when…”— Justin Skycak

  9. Official MA — what does this status mean?TechZing — 399: TZ Discussion - Vaporware

    “it's certainly path dependent so based on their performance in the past and how often they pass and and or failed lessons and reviews and how they tend to do on quizzes it kind of says…”— Jason Roberts

  10. Official MA — what does this status mean?TechZing — 399: TZ Discussion - Vaporware

    “you need to continually rerun simulations for students as they progress to get a more updated estimation of when they're going to complete”— Jason Roberts

  11. Official MA — what does this status mean?TechZing — 399: TZ Discussion - Vaporware

    “We can pretty much, we get the total number XP remaining and then we can just look at your pace and then we can kind of, okay, well, it looks like you're going to finish at the end of May or something, right?”— Jason Roberts

  12. Official MA — what does this status mean?TechZing — 370: TZ Discussion - Thank you, Mr. Helpful!

    “Ours is more complicated than that because it's path dependent on how they go through the course and what they have and have done. ... So every time a student completes a task, well, we have this thing, we have…”— Jason Roberts

  13. Official MA — what does this status mean?TechZing — 370: TZ Discussion - Thank you, Mr. Helpful!

    “every time a student completes a task, well, we have this thing, we have simulation server that's continually running and it says which students, their simulations are most out of date.”— Jason Roberts

Sources