The 21-year-old has failed a medical, according to reports in Switzerland due to a heart condition.
A statement on the Seagulls' official website confirmed: "Brighton & Hove Albion have withdrawn from the potential transfer Raphael Dwamena after the player failed the club's medical.
"The club would like to wish Raphael the very best for the future, as he returns to FC Zurich."
It is the second time this summer Albion have pulled out of a deal due to a player failing a medical.
FC Zurich said in a statement on their website: "We are very surprised at this decision. Naturally, we also had a medical examination carried out by the Schulthess Clinic before the move.
"The same deviation from normal was determined. However, this has been judged as being neither harmful to health nor compromising the performance of a top athlete.
"Whether a change in the medical situation has actually occurred in the last eight months is now being examined.
"Despite this unforeseen development, we are looking forward to the return of Raphael Dwamena and are convinced that he will again be fully committed to FC Zurich".
They were vindicated as Neto has since undergone knee surgery.
Earlier this year, the club's routine screening process uncovered that central defender Connor Goldson had a heart condition.
Goldson had surgery on a swollen aorta and is now back playing.
By Sammy Heywood Okine