Skip to content

Extend Bluesky Jetstream implementation #115

Description

@mark-torres10

Issue Description

We have a user request for Bluesky data, fetchable via Jetstream, that motivates our need to add more data to our data platform (see #111).

While building out that implementation more fully, we also want a more short-term solution to the user request. Please extend your Jetstream experimentation (#5). Please find 10 random Bluesky users who (1) follow AOC and (2) have >1,000 followers, and (3) have posted at least 5 posts in the past week. Grab their user handles. Then, for each, grab the following records: posts, likes, reposts, follows. Do so for the last 4 weeks.

Please export as posts.csv, likes.csv, reposts.csv, and follows.csv. Track the metadata in a metadata.json. Feel free to do this in an experiments/{folder name}/ folder. Please also record how long it took to run this in one shot, any patterns you notice while running it (e.g., it takes a while to run, it gets stuck in certain places, you have to restart it, etc).

The work you do here will also double as part of the start of implementation for #111, so please keep in mind an implementation that you'll be later able to extend and put into production.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions