AWS kinesis logs time stamp

Technical Question
,
1

Hi,

I have a AWS kinesis stream and it has extracted fine however in the log field it starts with 2023-02-16t16:07:57.375925804z stderr and I just wondered if there was a way to remove this in CRIBL.

2

Hi @joe06031990 ,

You could use the Mask function to remove this data.

As an example, I used the regex ^(?:[^\s]+\s){2} to match the first two fields (non-whitespace followed by whitespace x2 times)

Screen Shot 2023-02-19 at 10.30.46 AM
Screen Shot 2023-02-19 at 10.30.46 AM2234×958 185 KB

3

Thanks i ended up using a parser function and mask.