When I tried the first time it didn't work either, the next time it suddenly did work as advertised.
You already do it correctly, I think:
- when setting the POI, the green light must flash a couple of times
- when switching to POI mode, the copter must turn (yaw) towards the POI
- then you can...