Can I use thicker engine oil in the winter in my 2018 Accord?

Make a recording of the sound, if you can. But, take it to the dealer either way and tell them exactly what is happening. It's always good to document a problem. You may also want to try different brand of gas, it made a big difference with my 2018 so.

Also, never use thicker oil in the winter, the cold already makes it thicker.

My suggestion is a different English teacher at that college (one who can explain the proper use-case scenarios of the words ‘to, two, & too’). Additionally, consider that the source of your noise could be the fuel pump. I, too, was concerned about a noise emanating from my 2020 Accord 1.5T. I would describe my noise similarly to the way you described yours. I believe that my noise is the fuel pump and that this is normal and expected in a direct-injection car which needs very high fuel pressure.