Otel timeseries go missing

[phbnf]

From the logs:

"W0414 08:59:47.563558       1 handler.go:30] rpc error: code = InvalidArgument desc = One or more TimeSeries could not be written: timeSeries[0-106]: write for resource=generic_node{namespace:,node_id:,location:global} failed with: Points must be written in order. One or more of the points specified had an older start time than the most recent point."

[phbnf]

After speaking with Al about this and digging a bit more into it, I come to the conclusion that this is because there are multiple tasks exporting the same metric, and Otel cannot make any difference between them. Unfortunately, I don't think that this is supported: GoogleCloudPlatform/opentelemetry-operations-go#946.

[phbnf]

In the meantime, it should be doable with a sidecar, I think it's just not supported yet in https://github.com/GoogleCloudPlatform/opentelemetry-operations-go/