That is really creepy.
Nothing like that has ever happened to me, thank goodness. I could tell you what happened to a family member though.
It was a hot summer afternoon, and they went over to a friend's house. This friend lived in a very old, Victorian-era house with tons of secret rooms or tunnels, and strange creaks in the floorboards. Anyway, they were exploring, and discovered a secret passage behind a wardrobe in the guest bedroom. They went in, flashlight in hand, down the cramped wooden tunnel. Eventually they came to an intersection. Several other tunnels branched off into blackness. But they stopped. Right in the center of the room was an old porcelain baby doll, propped up and "reading" a dusty old Bible. They froze with fear, and after a minute the doll just fell backwards. They crawled as fast as they could, screaming, back out the tunnel.