First, are you in render view(z->Render) or material preview mode(z->material preview)? Second, make sure the camera icon to the right of the light in the outliner is solid(White by default theme). Also make sure that the camera icon is solid for any collections that the light is part of.
