Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

change signature of orphanedThreadFilter #45469

Conversation

stephane-airbyte
Copy link
Contributor

@stephane-airbyte stephane-airbyte commented Sep 13, 2024

  • Introduced a new OrphanedThreadInfo data class to encapsulate thread information to avoid data races when getting thread-specific information (like stacktrace, or threadLocal values)
  • Updated thread filtering and logging to use OrphanedThreadInfo
  • Enhanced logging for timeout tasks in LoggingInvocationInterceptor
  • fixed race condition in AirbyteTraceMessageUtilityTest
  • improved test logging to add the running tests for the destination containers
  • Modified TestContext to use a default value for CURRENT_TEST_NAME

Copy link

vercel bot commented Sep 13, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Skipped Deployment
Name Status Preview Comments Updated (UTC)
airbyte-docs ⬜️ Ignored (Inspect) Visit Preview Sep 17, 2024 1:15am

Copy link
Contributor Author

stephane-airbyte commented Sep 13, 2024

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @stephane-airbyte and the rest of your teammates on Graphite Graphite

@stephane-airbyte stephane-airbyte force-pushed the stephane/09-10-destination-snowflake_bump_cdk branch from 0e70ed1 to 6330d30 Compare September 13, 2024 23:35
@stephane-airbyte stephane-airbyte force-pushed the stephane/09-13-change_signature_of_orphanedthreadfilter branch from 06e8d2c to 2e5fdf1 Compare September 13, 2024 23:35
@stephane-airbyte stephane-airbyte force-pushed the stephane/09-10-destination-snowflake_bump_cdk branch from 6330d30 to 3e0f516 Compare September 14, 2024 00:20
@stephane-airbyte stephane-airbyte force-pushed the stephane/09-13-change_signature_of_orphanedthreadfilter branch from 2e5fdf1 to dd77b79 Compare September 14, 2024 02:02
@stephane-airbyte stephane-airbyte force-pushed the stephane/09-10-destination-snowflake_bump_cdk branch from 3e0f516 to 1ded4bf Compare September 14, 2024 03:02
@stephane-airbyte stephane-airbyte force-pushed the stephane/09-13-change_signature_of_orphanedthreadfilter branch 2 times, most recently from 9ea7da7 to b9fbff4 Compare September 14, 2024 03:23
@stephane-airbyte stephane-airbyte force-pushed the stephane/09-13-change_signature_of_orphanedthreadfilter branch 2 times, most recently from 7af5625 to b5ed686 Compare September 14, 2024 05:58
@stephane-airbyte stephane-airbyte force-pushed the stephane/09-10-destination-snowflake_bump_cdk branch from 9d78f10 to daab75f Compare September 15, 2024 18:05
@stephane-airbyte stephane-airbyte force-pushed the stephane/09-13-change_signature_of_orphanedthreadfilter branch from b5ed686 to 72151ff Compare September 15, 2024 18:05
@stephane-airbyte stephane-airbyte force-pushed the stephane/09-10-destination-snowflake_bump_cdk branch from daab75f to 708b5b8 Compare September 16, 2024 16:39
@stephane-airbyte stephane-airbyte force-pushed the stephane/09-13-change_signature_of_orphanedthreadfilter branch from 72151ff to 162f055 Compare September 16, 2024 16:40
@stephane-airbyte stephane-airbyte force-pushed the stephane/09-10-destination-snowflake_bump_cdk branch from 708b5b8 to fee0563 Compare September 16, 2024 17:19
@stephane-airbyte stephane-airbyte force-pushed the stephane/09-13-change_signature_of_orphanedthreadfilter branch 2 times, most recently from 48fb5f0 to 59b16fb Compare September 16, 2024 17:44
@stephane-airbyte stephane-airbyte changed the base branch from stephane/09-10-destination-snowflake_bump_cdk to master September 16, 2024 17:44
@stephane-airbyte stephane-airbyte force-pushed the stephane/09-13-change_signature_of_orphanedthreadfilter branch 3 times, most recently from fffb246 to 90e3ffd Compare September 16, 2024 20:19
@octavia-squidington-iii octavia-squidington-iii removed the area/connectors Connector related issues label Sep 16, 2024
@stephane-airbyte stephane-airbyte force-pushed the stephane/09-13-change_signature_of_orphanedthreadfilter branch 2 times, most recently from f49e6a6 to 90c1a66 Compare September 16, 2024 21:00
@stephane-airbyte stephane-airbyte marked this pull request as ready for review September 16, 2024 21:56
@stephane-airbyte stephane-airbyte requested review from a team as code owners September 16, 2024 21:56
@stephane-airbyte stephane-airbyte requested review from edgao and johnny-schmidt and removed request for a team September 16, 2024 21:57
Copy link
Contributor

@edgao edgao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

changes seem reasonable, though I'm unclear on what the thread info actual race condition is - can you say a bit more about that?

(everything else looks like nice qol improvements + the sad stderr thing)

@@ -493,6 +517,7 @@ internal constructor(
}

private fun dumpThread(thread: Thread): String {
OrphanedThreadInfo.getForThread(thread)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this doesn't seem to do anything?

// stdout while we run this test, in which case we'd see their messages.
// we filter through the messages to find an error (hopefully hours)
for (line in outCt.split('\n')) {
if (line.contains("\"error\"")) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

😢

it looks like we're expecting a json blob - can we filter for something like "type":"trace"? or maybe filter for lines that are valid json

(otherwise wouldn't this trigger for any logger.warn("error while blah blah") message?)

@stephane-airbyte stephane-airbyte force-pushed the stephane/09-13-change_signature_of_orphanedthreadfilter branch from 90c1a66 to c35540c Compare September 17, 2024 01:15
@stephane-airbyte stephane-airbyte merged commit 6d74db7 into master Sep 17, 2024
30 checks passed
@stephane-airbyte stephane-airbyte deleted the stephane/09-13-change_signature_of_orphanedthreadfilter branch September 17, 2024 21:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants