Skip to content

Conversation

borfast
Copy link
Collaborator

@borfast borfast commented Oct 5, 2025

This is a follow-up to #3432, to fix the problem mentioned there, of not being able to use activity types to filter data for the "Top LF projects" widget.

It adds a new copy pipe that is similar to insightsProjects_filtered pipe but includes filtering for activity types, which we don't have on the former, and also uses some hard-coded filters for the Top LF projects widget to mimic the way the widget currently fetches data using dynamic filters.

These have to be hard-coded because this is a copy pipe and thus, we can't use dynamic filtering.

These pipes and corresponding data source exist just for the aforementioned widget, because adding the activity type filtering to insightsProjects_filtered could have too much of a performance hit, and that pipe is used in a lot of other places, so we would negatively impact the whole application.

@borfast borfast requested a review from gaspergrom October 5, 2025 12:11
@borfast borfast self-assigned this Oct 5, 2025
@borfast borfast requested a review from epipav as a code owner October 5, 2025 12:11
Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Conventional Commits FTW!

@borfast borfast changed the title Add new pipes to filter data by activity types for the Top LF projects widget [IN-707] chore: add new pipes to filter data by activity types for the Top LF projects widget [IN-707] Oct 5, 2025
Copy link
Contributor

@gaspergrom gaspergrom left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Best that also anil reviews

@borfast
Copy link
Collaborator Author

borfast commented Oct 6, 2025

We decided to do this differently and filter on services/libs/tinybird/pipes/segmentId_aggregates_mv.pipe, which has the advantage that it covers other downstream pipes as well. The change was done here.
Closing this one.

@borfast borfast closed this Oct 6, 2025
@borfast borfast deleted the feat/IN-707-add-pipes-for-top-projects branch October 9, 2025 13:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants