Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[81] - add operator to encode videos into vector embeddings using CLIP-ViT-B-32 #369

Merged
merged 14 commits into from
Aug 8, 2024
Merged

[81] - add operator to encode videos into vector embeddings using CLIP-ViT-B-32 #369

merged 14 commits into from
Aug 8, 2024

Conversation

Snehil-Shah
Copy link
Contributor

Resolves #357.

Summary

  • added the vid_vec_rep_clip operator.
  • added tests for the above operator.
  • updated Dockerfile to fix 404s when fetching ffmpeg.

aatmanvaidya and others added 13 commits May 28, 2024 14:00
@aatmanvaidya
Merge pull request tattle-made#339 from tattle-made/development
a1c22d3 
Merge Dev to Main
0.7.0
97d9f5a 
Automatically generated by python-semantic-release
@duggalsu
fix: Updated github action versions to latest
44b46ad
@duggalsu
Merge pull request tattle-made#341 from duggalsu/update_scorecard_wor…
b2e2aa8 
…kflow

Update scorecard workflow
@duggalsu
Merge pull request tattle-made#342 from tattle-made/hotfix
eecc55f 
Hotfix
0.7.1
3f612dc 
Automatically generated by python-semantic-release
@duggalsu
fix: Updated pr-security workflow
fe9c26a 
fix: Removed ignored vulnerabilities that were fixed
@duggalsu
Merge pull request tattle-made#343 from duggalsu/update_pr_security_w…
b26a03c 
…orkflow

Update pr security workflow
@duggalsu
Merge pull request tattle-made#344 from tattle-made/hotfix
10a277c 
Hotfix
0.7.2
ccbfb6c 
Automatically generated by python-semantic-release
@aatmanvaidya
chore: removing docs gatsby website
03f5ac0
@dennyabrain
Merge pull request tattle-made#367 from aatmanvaidya/remove-docs
2b9275a 
chore: removing docs gatsby website
@Snehil-Shah
feat: add vid_vec_rep_clip operator
8874ce5 
Signed-off-by: Snehil Shah <[email protected]>
@aatmanvaidya aatmanvaidya self-requested a review August 7, 2024 12:45
@Snehil-Shah Snehil-Shah changed the title feat: add operator to encode videos into vector embeddings using CLIP-ViT-B-32 [81] - add operator to encode videos into vector embeddings using CLIP-ViT-B-32 Aug 7, 2024
@Snehil-Shah Snehil-Shah mentioned this pull request Aug 7, 2024
Closed
6 tasks
aatmanvaidya
aatmanvaidya reviewed Aug 8, 2024
View reviewed changes
Copy link
Collaborator

@aatmanvaidya aatmanvaidya left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

test comment

src/core/operators/vid_vec_rep_clip.py Outdated Show resolved Hide resolved
@aatmanvaidya aatmanvaidya changed the base branch from main to development August 8, 2024 11:44
@aatmanvaidya aatmanvaidya changed the base branch from development to main August 8, 2024 11:44
@aatmanvaidya aatmanvaidya changed the base branch from main to development August 8, 2024 11:49
@aatmanvaidya aatmanvaidya merged commit c5f09de into tattle-made:development Aug 8, 2024
3 of 4 checks passed
Snehil-Shah
Snehil-Shah commented Aug 8, 2024
View reviewed changes
src/core/operators/vid_vec_rep_clip.py

# Extract I-frames and features
self.frame_images = self.extract_frames(fname)
print(len(self.frame_images))
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@aatmanvaidya forgot to remove this print statement :(

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@aatmanvaidya aatmanvaidya aatmanvaidya approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Create an video operator using CLIP
4 participants
@Snehil-Shah @aatmanvaidya @duggalsu @dennyabrain