It's very family friendly. We have a 4 year old and have lived here since he was 5months. There are loads of baby groups and se23 mums Facebook page is very active if your want to keep an eye on what's available.
I used a sling rather than a pushchair which worked well.
There are shops and restaurants on Forest Hill and Honor Oak both of which arenables walkable.
Welcome to the area!