It sounds like you’re just looking at the number not the arrow. Also, you’re assuming a fingerprick is completely accurate. If you did multiple fingerpricks you could easily have one finger say 4.3 and a different finger say 3.6. None of these things are 100% accurate
Note the below is an example of the questions you could ask yourself I’m not literally asking you these questions.
You need to look at the overall picture not just the number. So if libre says 4.3, what direction is the arrow, is it going up or down? Are you active and walking about, or about to drive, or sitting on the sofa having just had a snack, or about to eat your tea? When did you last take insulin? The circumstances as well as the arrow, and the insulin on board, together help you inform your decision on what action to take.
Having said that, if the libre is stressing you out then you don’t have to use it, you do still have the option of sticking to fingerpricks.