Cops arrested him Wednesday at the Union Square subway station. He had a small camera hidden inside a pen, police said.
After obtaining a search warrant for the camera, police found images taken under the woman's skirt, according to reports.
Levinson was arraigned early Thursday morning. A judge set bail at $5,000 cash over $15,000 bond.
He is due back in court October 15.
Levinson, a urologist, works at Mount Sinai. In a statement, a hospital spokesperson said: "This is a police matter and Mount Sinai is cooperating fully with the authorities. The employee has been suspended pending the result of the investigation by the District Attorney's office."