want to take my 5 year old fishing but need advice

[UphillHabit]

I'm thinking about taking my 5-year-old out fishing for the first time. I've never really fished before, so I'm a bit lost on what to do. I saw some starter rods at a store and wondered if that's where to begin. Is there a simple setup that's good for kids? I really just want to create some fun memories together outdoors.