Skip to content

Decide which OSM edit-review tool(s) our output should target, and how -- not just "MapRoulette" #696

Description

@brawer

This repo's README currently states the plan as "automatically feed edit proposals to MapRoulette." That's not actually settled — this issue is to think it through properly and produce a real plan, before building against any one tool as if it were the only option.

MapRoulette specifically

Already discussed with the MapRoulette team directly; a few things are already clear, the rest isn't:

  • Hosting: we host the (potentially large) generated challenge GeoJSON ourselves, in MapRoulette's own challenge format, on a publicly accessible URL — likely S3, since this pipeline already uploads its other outputs there and S3 makes them public automatically. Our pipeline then sends a small authenticated REST call to MapRoulette itself, telling it to (re-)fetch from that URL. Planned cadence: once a week, so challenges don't go stale.
  • Scale is a real problem, not a hypothetical one: our data is potentially millions of tasks, far above MapRoulette's normal volume. We need to figure out the actual mechanics — sharding, pacing, whatever it takes — so we don't take MapRoulette down. No plan for this yet.
  • Task quality / reviewer trust: MapRoulette's own stated concern is that users blindly click "Accept" on tasks without doing any real verification. If that happens with our tasks at scale, bad edits land in OSM. We need a real answer here, not just "we'll write good instructions."

Splitting/sharding tasks so they're actually reviewable

Open questions, not yet decided:

  • Split by store brand?
  • Split by which OSM tag is being changed — separate tasks for opening_hours vs. website vs. phone vs. others?
  • A separate task category for new stores: appears in a brand's store finder (i.e., in the AllThePlaces scrape) but has no matching OSM feature yet.
  • A separate task category for likely-closed stores: we have a matching OSM feature tagged as this brand, but it's no longer in the brand's store finder (either genuinely closed, or it was never accurately listed there in the first place).

The bigger question: not every edit belongs on MapRoulette

Different kinds of edits likely suit different review tools, each with a different audience and review model:

We need an actual plan for which categories of edits go to which system(s), not an assumption that everything funnels into one tool.

Scope of this issue

This is deliberately high-level and not blocking the v0.7.0 release. The point is to think this through and land on a real plan — not to implement anything here.


Written with Claude on behalf of @brawer

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions