Activity index

[thelostone-mc]

Description

• Introduces ActivityIndex to mimic rolling window for Activity
• Has a cronjob that removes ActivityIndexes older than 400 days
• Have a helper function which populates ActivityIndex for last 400 days of activity
• Updates the backend to ensure ActivityIndex is created when Activity is created
• Updates the read calls to rely on ActivityIndex to fetch activities (would need help in figuring out a nicer way to do this @owocki @gdixon )

TO POPULATE INDEX

from dashboard.management.commands.cleanup_activity_index import *
port_activity_to_index()

Type of ActivityIndex

• tip:<id>
• hackathon:<id>
• bounty:<id>
• kudo:<id>
• grant:<id>
• profile:<id>
• project:<id>

Revisit Usage

• get_various_activities L4288
• reassemble_profile_dict
• psave_answer
• HackathonProjectSerializer
• video_presence
• def api(request, activity_id):
• def get_param_metadata(request, tab):
• increment_view_counts
• get_specific_activities
• get_activities
• hackathon_project_page
• project_data
• def quickstart(request):

Flows Tested to make sure ActivityIndex is populated

• Tips
• Bounty
• Grant
• Kudos
• Hackathon
• Project
• Profile (error when you run out of results -> seems to be an exisiting error)
• Townsquare

[owocki]

alternatively you could do this in one query activities_index__key__startswith='profile'

[owocki]

id be interested in if this does 2 queries or 1 and if 2 which is more efficient.

[owocki]

is there a migration to backport all of the old activities?

[thelostone-mc]

Yup this should do that

[owocki]

looks like its getting close . ill be curious if its actually more performant in a production-like setting.

lets move forward on this!