iX dZddlZddlmZddlmZmZmZmZddlZ ddl m Z m Z m Z ddlmZmZej"dZe j&e j(e j*e j,e j.e j0e j.e j.e j2e j2d Zd ed ed eeeeffd Zd ed ed eeeeffdZd ed eeeeffdZd ed eeeeffdZy)u Tier 1: Official source ingestion. Ingests roster, availability, and lineup data from the existing sportsdb tables (PlayerInjury, SportsGame, PlayerGameMetric, etc.) which are already populated by the SGO pipeline, CBS, ESPN, FantasyPros crons. This module does NOT invent fake data — it reads what the existing ingestion pipeline has already collected and normalizes it for validation. N)datetime)ListDictAnyOptional)AvailabilityStatus LineupStatus SourceTier)normalize_player_namenormalize_team_abbrevz pub-integrity) outir suspensiondoubtful questionableprobablez day-to-daydtdactive availableleaguerun_idreturnc B|jtjj}|j d||f|j }|j i}|D]<}t|d}||vr#||}|d|jddkDr|||<8|||<>g} |jD]\}}|dxsdjj} tj| tj} | jr|ddkrtj } | j#|d||jd d| | d |dd t$j&|jd |d t(j+dt-| d|| S)z Read PlayerInjury table for confirmed availability statuses. Uses 2-source confirmation for OUT/IR/Suspension (matching existing logic in odds-refresh.ts). Single-source reports are included as QUESTIONABLE/PROBABLE. cursor_factorya SELECT pi."playerName", pi.status, pi.source, pi.team, pi."updatedAt", sc.source_count FROM "PlayerInjury" pi JOIN ( SELECT LOWER("playerName") AS pn, status, COUNT(DISTINCT source) AS source_count FROM "PlayerInjury" WHERE LOWER(league) = LOWER(%s) AND "updatedAt" > NOW() - INTERVAL '7 days' GROUP BY LOWER("playerName"), status ) sc ON LOWER(pi."playerName") = sc.pn AND pi.status = sc.status WHERE LOWER(pi.league) = LOWER(%s) AND pi."updatedAt" > NOW() - INTERVAL '7 days' ORDER BY pi."updatedAt" DESC playerName source_countrstatusteamzPlayerInjury (z sources) updatedAt) player_namenormalized_namer"availability_statusdetailed_statussource source_tiersource_timestampr[official] Ingested z availability reports for )cursorpsycopg2extrasRealDictCursorexecutefetchallcloser getitemslowerstripINJURY_STATUS_MAPr UNKNOWN is_blocking QUESTIONABLEappendr OFFICIALloginfolen) connrrcurrowsplayer_reportsrowpnameexistingresults raw_statusavails O/var/www/html/rainmaker/backend/scripts/publishing_integrity/official_ingest.py!ingest_availability_from_injuriesrK&s ++X__%C%C+ DCKK &  <<>DIIK13N$%c,&78 N "%e,H>"X\\.!%DD(+u%  #u$G$**, s(m)r00288: !%%j2D2L2LM   ^!4q!8&33E|,$GGFB'#()&s>':&;9E%.. # 4   (HH#CL>1KF8 TU Nc |jtjj}|j d|f|j }|j g}|D]L}|j|dt|dt|dxsd|dtj|d|dNtjd t|d ||S) z Read PlayerGameMetric to determine current roster/team assignments. PGM tracks which players appear in games for which teams. ra SELECT DISTINCT ON (LOWER("playerName")) "playerName", team, "gameDate", league FROM "PlayerGameMetric" WHERE LOWER(league) = LOWER(%s) AND "gameDate" > NOW() - INTERVAL '30 days' ORDER BY LOWER("playerName"), "gameDate" DESC rr"r PlayerGameMetricgameDate)r$r%r"rr(r)last_game_daterr+z roster entries from PGM for )r,r-r.r/r0r1r2r;r r r r<r=r>r?)r@rrrArBrGrDs rJingest_rosters_from_pgmrQgs ++X__%C%C+ DCKK  <<>DIIKG  |,4S5FG)#f+*;<(%..!*o    HH#CL>1Nvh WX NrLc@|jtjj}|j d|f|j }|j tjdt|d||Dcgc] }t|c}Scc}w)z7Read today's games from rm_events for the given league.raa SELECT event_id, league, home_team, away_team, home_short, away_short, starts_at, status FROM rm_events WHERE LOWER(league) = LOWER(%s) AND DATE(starts_at AT TIME ZONE 'America/New_York') = (NOW() AT TIME ZONE 'America/New_York')::date AND status != 'ended' ORDER BY starts_at ASC [official] Found z today's games for ) r,r-r.r/r0r1r2r=r>r?dict)r@rrArBrs rJingest_today_gamesrVs ++X__%C%C+ DCKK  <<>DIIKHH T +>vh GH! "DG "" "sBcZ|jtjj}|j d|f|j }|j g}|D]}|dxsi}|jdg}|D]t}|jdd} | s|j|d||d|d | t| |jd d|jd d|jd dd vtjdt|dt|d||S)u Read player prop highlights from today's forecasts in rm_forecast_cache. These are the props that would be published — the validation targets. rav SELECT fc.event_id, fc.league, fc.home_team, fc.away_team, fc.forecast_data, fc.confidence_score FROM rm_forecast_cache fc WHERE LOWER(fc.league) = LOWER(%s) AND (fc.starts_at AT TIME ZONE 'America/New_York')::date = (NOW() AT TIME ZONE 'America/New_York')::date AND fc.forecast_data IS NOT NULL forecast_dataprop_highlightsplayerr event_id home_team away_teamproprecommendation reasoning) r[rr\r]r$r% prop_typer_r`rSz player props across z forecasts for ) r,r-r.r/r0r1r2r3r;r r=r>r?) r@rrArBpropsrDfdrYr^r$s rJingest_forecast_propsrds8 ++X__%C%C+ DCKK  <<>DIIK E  ! 'R&&!2B7# D((8R0K LL O  - -*#8#E!XXfb1"&((+;R"@!XXk26    &HH U ,A#d)O\b[c de LrL) __doc__loggingrtypingrrrrpsycopg2.extrasr-enumsr r r normalizationr r getLoggerr=OUTINACTIVE SUSPENDEDDOUBTFULr:PROBABLE AVAILABLEr7strrKrQrVrdrLrJrts- ,,??Gg(  ! !  % %$.."++&33"++$11  * * **#-- >C>>dSVX[S[nI]>B!#!s!tDcN?S!H#S#T$sCx.-A#(((T#s(^0D(rL