Timestamp literal in tests

[tadej0mins]

Hello,

I got the following vector.yaml configuration:

sources:
  vector_internal_logs:
    type: "internal_logs"

transforms:
  vector_internal_format:
    type: "remap"
    inputs:
      - "vector_internal_logs"
    source: |-
      . = {
          "time": format_timestamp!(.timestamp, format: "%FT%T%.3f"),
          "message": .message
      }

sinks:
  console:
    type: "console"
    inputs:
      - "vector_internal_format"
    encoding:
      codec: "json"

tests:
  - name: "vector_internal_format"
    inputs:
      - insert_at: "vector_internal_format"
        type: "log"
        log_fields:
          timestamp: t'2023-10-05T12:44:54.345262416Z'
          message: "Some message"

    outputs:
      - extract_from: "vector_internal_format"
        conditions:
          - type: "vrl"
            source: |-
              assert_eq!(.time, "2023-10-05T12:44:54.345", "time invalid")

I want to test vector_internal_format transformation and I don't know how to specify timestamp input (under log_fields) to be of a type Timestamp (so that format_timestamp function would not throw an error: expected timestamp, got string).

[jszwedko]

You should be able to use the syntax shown here: https://vector.dev/docs/reference/vrl/expressions/#timestamp

[precisionconage]

I just ran into this too. Looks like log_fields only tries to parse properties as strings, bools, ints, or floats

AFAICT, this will be possible with VRL test inputs once #19107 is included in a release. I haven't found a good way to pass timestamps to tests in the meantime.

[tmccombs]

Is there a way to do this with log_fields?

[precisionconage]

Looks like log_fields still only tries to parse properties as strings, bools, ints or floats, so I'm guessing no.

[jszwedko]

Indeed, log_fields doesn't support injecting a timestamp at the moment. However, you can specify the inputs with VRL which would allow specifying a timestamp field. See example on https://vector.dev/docs/reference/configuration/unit-tests/#logs