GPS crash on getting a FIX(I think)

As from the title, I’m having an issue with the GPS module,
It seems like it can obtain satellite information (GPGSV), however, after some lines of not fix:

$GPGSV,2,1,08,17,13,316,29,01,69,319,,03,40,299,,04,30,223,*7D
$GPGSV,2,2,08,08,21,203,,09,,,,10,,,,14,,,*46
$GPVTG,,T,,M,,N,,K,N*2C
$GPGSA,A,1,,,,,,,,,,,,,,,*1E
$GPGGA,,,,,,0,,,,,,,,*66
$GPRMC,,V,,,,,,,,,,N*53

No satellite data available.

$GPGSV,2,1,08,17,13,316,28,01,69,319,,03,40,299,,04,30,223,*7C
$GPGSV,2,2,08,08,21,203,,09,,,,10,,,,14,,,*46
$GPVTG,,T,,M,,N,,K,N*2C
$GPGSA,A,1,,,,,,,,,,,,,,,*1E
$GPGGA,,,,,,0,,,,,,,,*66
$GPRMC,,V,,,,,,,,,,N*53

No satellite data available.

$GPGSV,2,1,08,17,13,316,28,01,69,319,,03,40,299,,04,30,223,*7C
$GPGSV,2,2,08,08,21,203,,09,,,,10,,,,14,,,*46
$GPVTG,,T,,M,,N,,K,N*2C
$GPGSA,A,1,,,,,,,,,,,,,,,*1E
$GPGGA,,,,,,0,,,,,,,,*66
$GPRMC,,V,,,,,,,,,,N*53

I always got this error:

Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/serial/serialposix.py", line 501, in read
    'device reports readiness to read but returned no data '
serial.serialutil.SerialException: device reports readiness to read but returned no data (device disconnected or multiple access on port?)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "GPS.py", line 65, in <module>
    data = ser.readline().decode('utf-8')
  File "/usr/lib/python3/dist-packages/serial/serialposix.py", line 509, in read
    raise SerialException('read failed: {}'.format(e))
serial.serialutil.SerialException: read failed: device reports readiness to read but returned no data (device disconnected or multiple access on port?)

I’m not very good at debugging hardware, so I wanted to ask for some help pinpoint the issue.

Other info:
Kernel: 5.10.52-v7+
BG96:firmware: BG96MAR02A10M1G