Best way to incrementally print table rows?

[davidgilbertson]

Use case: I'm training a machine learning model. It prints a handful of metrics a few times a minute. It might also print out other messages between these.

If I just print the dicts, I get something like this:

But I want it to be pretty, like this:

It prints each row as it comes, headers are repeated every n lines, and any other printed messages will show between the table rows.

It must work in the PyCharm Python console (I tried one of the Live demos and it looked very broken)

I've got something working, but it seems a bit hacky, I'm wondering if there is a simpler way? I'd love to be able to print a table with headers hidden, but have the width-calculating function pretend as though there were headers (otherwise each 'row' gets printed with different cell widths)

class Table:
    def __init__(self):
        self.console = rich.console.Console(force_terminal=True, width=140)
        self.rows_printed = 0
        self.header_every = 10
        self.widths = None

    def print_row(self, data: dict):
        table = RichTable(
            box=None,
            expand=True,
            header_style="blue bold",
        )

        for col in data.keys():
            table.add_column(col, justify="right")

        row = []
        for item in data.values():
            if isinstance(item, float):
                if item < 1e-4:
                    item = f"{item:.2e}"
                else:
                    item = f"{item:,.5f}"
            if isinstance(item, int):
                item = f"{item:,.0f}"

            row.append(str(item))

        table.add_row(*row)

        # Should we skip the header for this row?
        if self.rows_printed % self.header_every != 0:
            # Calculate widths including header and data
            if self.widths is None:
                self.widths = table._calculate_column_widths(
                    self.console, self.console.options
                )

            # Hard code those widths since we won't have a header
            for col, width in zip(table.columns, self.widths):
                col.width = width

            table.show_header = False

        self.console.print(table)
        self.rows_printed += 1
        return table

table = Table()
for item in data:  # a list of dicts with the same keys
    table.print_row(item)