[Call for proposal] Add an observability dashboard for ease of evaluation

[mark-torres10]

Issue Description

Now that we're introducing observability into our pipeline, we want to be able to connect that observability to an external dashboard. We want a simple interface where we can look at the jobs and sync the statuses from either Dynamo or from the telemetry software. Attached below are a series of mock-ups of how this can look.

We want this to then eventually be available as an externally available link to users.

Please create a proposal for how to implement something like this. There are two ways I imagine doing this, though feel free to suggest others:

1. A custom website, where the backend, on load, loads the job statuses (loads the latest jobs from DynamoDB, by timestamp), and then the frontend just populates the individual table rows.
2. A custom Grafana dashboard.

The end goal is to have something that a member of the technical team can quickly look at to see how the pipelines are running without having to know much about the telemetry setup. Ideally we could include this in a runbook to describe how we can judge and evaluate how the pipelines are working.

Attached are some GPT-generated mock-ups for possible inspiration (this is for the "custom website" route).

Here are some GPT-generated mock-ups for Grafana dashboards:

[mark-torres10]

What I'll be looking at most here is:

• What metrics do you think are most important to track?
• What visuals do you think are most compelling for a 1-page snapshot?