Johnson & Johnson on Wednesday said it is recalling most of its Neutrogena and Aveeno spray sunscreens from U.S. stores after detecting benzene, a potentially cancer-causing chemical, in some samples.

J&J said people should stop using and discard five of its six Neutrogena and Aveeno spray sunscreens. The company said it is also telling distributors and retailers to stop selling the products.

On Thursday, CVS Health Corp. followed suit, saying it has halted sales of two sun-care products.

Here’s what else you need to know.

Which Neutrogena and Aveeno sunscreen products are being recalled?

The recall doesn’t include all of Johnson & Johnson’s sunscreens. It only applies to five spray sunscreens sold under the Neutrogena and Aveeno labels: Neutrogena Beach Defense, Neutrogena Cool Dry Sport, Neutrogena Invisible Daily, Neutrogena Ultra Sheer and Aveeno Protect + Refresh aerosol sunscreens.

The company sells one other spray sunscreen product, Neutrogena Wet Skin, which isn’t affected, J&J said.

Why are they being recalled?

The recall came after an online pharmacy said it found high levels of benzene in 24 sunscreens and other suncare products. The pharmacy, Valisure LLC, petitioned the FDA to remove the products, including some of those recalled by J&J. The online pharmacy’s testing had previously led to recalls of popular heartburn drug Zantac and diabetes drug Metformin.

J&J said it doesn’t use benzene in the manufacturing of the spray sunscreens and is investigating the cause of the contamination.

What is benzene?

Benzene is a chemical that can cause cancer after high levels of exposure. High levels of exposure can also have more immediate effects, including dizziness, confusion and rapid or irregular heartbeats.

Do I need to worry if I’ve used this sunscreen?

J&J didn’t say how many bottles were affected and what the exact benzene levels were. But it said the levels were low and not expected to cause health issues. If you have any concerns, talk to your doctor.

Can I get a refund?

J&J says consumers may contact the company’s consumer care center with questions or to request a refund by calling 1-800-458-1673.

How can I report adverse reactions or other problems with these sunscreens?

First, talk to your doctor. Reactions or quality problems experienced with the use of the recalled sunscreens may be reported to the FDA’s MedWatch Adverse Event Reporting program.

Which sun-care products is CVS pulling?

The products being pulled by CVS—CVS Health After Sun Aloe Vera and CVS Health After Sun Aloe Vera Spray—also are on Valisure’s list, along with several other brands.

Why did CVS pull those products?

A CVS spokesman said the company halted sales of the products out of an abundance of caution and is working with the supplier to take appropriate additional steps. CVS and J&J don’t use the same supplier for the items, he said. He declined to say when CVS stopped selling the products.

“We remain committed to ensuring the products we offer are safe, work as intended, comply with regulations and satisfy customers,” the spokesman said.

—Sharon Terlep contributed to this article.

Write to Ellen Byron at ellen.byron@wsj.com