o &_h8@sdZddlZddlZddlmZddlmZddlmZm Z m Z ddl m Z ddl Z ddl mZmZddlZddlZddlmZdd lmZdd lmZdd lmZdd lmZdd lmZddlm Z m!Z!m"Z"ddl#m$Z$ddl%Z&eGdddZ'eGdddZ(eGdddZ)GdddZ*GdddZ+GdddZ,GdddZ-GdddZ.Gd d!d!Z/d"d#Z0Gd$d%d%Z1d&d'Z2e3d(kre2dSdS))zv QLD License Checker ================================================================================================ N)Path) dataclass)ListDictOptional)datetime)ThreadPoolExecutor as_completed webdriverOptionsBy)Keys WebDriverWaitexpected_conditions)TimeoutExceptionWebDriverExceptionNoSuchElementException)fuzzc@sreZdZUdZdZeed<dZeed<dZ eed<dZ eed <d Z e ed <d Z eed <dZeed<dZeed<dS) SimpleConfigzSimple configurationhttps://www.qld.gov.au/law/laws-regulated-industries-and-accountability/queensland-laws-and-regulations/check-a-licence-association-charity-or-register/check-a-licence website_urlUname_similarity_requiredmax_retry_attemptsrequest_timeout_seconds?delay_between_requestsparallel_browsersT test_modetest_record_limitN)__name__ __module__ __qualname____doc__rstr__annotations__rintrr!r#floatr%r&boolr(r2r2/var/www/html/scrapers/qld.pyr#s        rc@sTeZdZUdZeed<eed<eed<eed<dZeed<dd Zd e fd d Z d S)EmployeeRecordz)Holds one employee's information from CSVpayroll_number employee_namelicense_number csv_expiryrcsv_row_numbercCsDt|j|_t|j|_t|j|_t|j|_dS)z)Remove extra spaces and clean up the dataN)r-r5stripr6r7r8selfr2r2r3 clean_dataKszEmployeeRecord.clean_datareturncCst|jo|jS)z9Check if this record has the minimum required information)r1r7r6r;r2r2r3has_required_dataRz EmployeeRecord.has_required_dataN) r)r*r+r,r-r.r9r/r=r1r?r2r2r2r3r4Bs  r4c@seZdZUdZdZeed<dZeeed<dZ eed<dZ eed<dZ eed <d Z eed <d Z eed <dZeed<dZeed<ddZdefddZdefddZdefddZdS) SearchResultz)Holds the result of searching QLD website Not Found found_nameNlicense_activitieslicense_expiry No License name_matches expiry_status error_messagerhow_many_retriessearch_time_secondsF was_cachedcCs|jdur g|_dSdSN)rDr;r2r2r3 __post_init__ds  zSearchResult.__post_init__r>cCs|jdko|j S)z-Did we successfully find license information?rB)rCrJr;r2r2r3 is_successfulhszSearchResult.is_successfulcCs&|jsdSt|jddd}d|S)zEReturn formatted activities string with security officer prioritized.rBcS$d|vr d|fSd|fSNzSECURITY OFFICER (UNARMEDrr'upperxr2r2r3t$z7SearchResult.get_formatted_activities..key, )rDsortedjoinr<sorted_activitiesr2r2r3get_formatted_activitiesls z%SearchResult.get_formatted_activitiescCs$|jsdSt|jddd}|dS)z Return the primary license type.rBcSrRrSrTrVr2r2r3rXrYz2SearchResult.get_primary_license..rZr)rDr]r_r2r2r3get_primary_licensexsz SearchResult.get_primary_license)r)r*r+r,rCr-r.rDrrErGrHrJrKr/rMr0rNr1rPrQrarbr2r2r2r3rAWs          rAc@sNeZdZdZdefddZddZdejfdd Z d d Z d d Z ddZ dS)OptimizedBrowserManagerz6Manages multiple Chrome browsers for reliable scrapingconfigcCs*||_t|_g|_d|_t|_dSNF) rdqueueQueue browser_pool all_browserssetup_complete threadingLocklock)r<rdr2r2r3__init__s  z OptimizedBrowserManager.__init__cCs|jrdS|jI|jr WddStd|jjdt|jjD]}|}|j||j |td|ddq%d|_tdWddS1sTwYdS) z.Create Chrome browsers for parallel processingNz Setting up z Chrome browsers...z Browser r'z readyTz+All browsers ready for parallel processing!) rjrmprintrdr%range_create_chrome_browserriappendrhput)r<ibrowserr2r2r3setup_browserss   "z&OptimizedBrowserManager.setup_browsersr>cCst}|d|d|d|d|d|d|d|d|d |d |d |d |d |d|d|d|d|d|ddg|ddtj|d}|d|S)z/Create one Chrome browser with optimal settings --headless --no-sandbox--disable-dev-shm-usagez --disable-gpuz--disable-extensionsz--disable-loggingz--disable-web-securityz--window-size=1280,720z%--disable-background-timer-throttlingz --disable-renderer-backgroundingz(--disable-backgrounding-occluded-windowsz!--disable-ipc-flooding-protectionz--disable-features=TranslateUIz--disable-default-appsz--no-first-runz--memory-pressure-offz --allow-running-insecure-contentz---disable-blink-features=AutomationControlledexcludeSwitcheszenable-automationuseAutomationExtensionFoptionszEObject.defineProperty(navigator, 'webdriver', {get: () => undefined}))r add_argumentadd_experimental_optionr Chromeexecute_script)r<chrome_optionsdriverr2r2r3rqs0                     z.OptimizedBrowserManager._create_chrome_browsercCs.|js||j}t||jj}||fS)z)Get a browser from the pool (thread-safe))rjrvrhgetrrdr!)r<ru wait_helperr2r2r3 get_browsers  z#OptimizedBrowserManager.get_browsercCs|j|dS)z Return browser to pool when doneN)rhrs)r<rur2r2r3return_browserr@z&OptimizedBrowserManager.return_browsercCsNd}|jD]}z|Wq|d7}Yq|dkr%td|ddSdS)z$Close all browsers when program endsrr'z WARNING: z" browsers failed to close properlyN)riquitro)r<failed_cleanupsrur2r2r3cleanup_all_browserss   z,OptimizedBrowserManager.cleanup_all_browsersN) r)r*r+r,rrnrvr rrqrrrr2r2r2r3rcs  rcc@seZdZdZdedefddZdedefdd Zdedefd d Z d ed edefddZ dededefddZ dedefddZ de ededefddZdedefddZdedefddZdejd ededefd!d"Zd#S)$SeleniumLicenseSearcherz.Searches QLD government website using Seleniumrdbrowser_managercCs&||_||_i|_t|_i|_dSrO)rdr search_cacherkrl cache_lock name_cache)r<rdrr2r2r3rns   z SeleniumLicenseSearcher.__init__namer>cCs~|sdS||jvr|j|S||}|}t|dkr2|ddd|dd}n|}||j|<|S)zEConvert name to standard format for comparison with enhanced cleaningrIrr\ N)r_clean_name_for_matchingr:rUsplitlenr^)r<r cleaned_nameparts normalizedr2r2r3normalize_employee_names    "  z/SeleniumLicenseSearcher.normalize_employee_namecCs|sdSt|}d|}|}g}|D] }t|dkr*t|dkr*q|dr6t|dkr6q||qg}|D]}d|vrQ|d}||q@||q@dd|D}|red|S|S) z>Clean name by removing common variations and formatting issuesrIrr'.r$-cSsg|]}|r|qSr2)r:).0wordr2r2r3 +szDSeleniumLicenseSearcher._clean_name_for_matching..) r-r:r^rrUrendswithrrextend)r<rcleanedwordsfiltered_wordsrprocessed_words hyphen_partsr2r2r3rs(      z0SeleniumLicenseSearcher._clean_name_for_matchingcsv_name website_namec Cs|dkrdS|r |s dS||}||}||}||}||kr&dS||kr0dSt||t||t||t||g}t|}||j j kr^dSd|ddS)z|r|dkrdS|}t|dkrU|ddkrU|d}t|dkrSt|ddkrStj}t|dd}|d|ddrS||dd|d<d |}|St|dkr|ddkr|d}t|dkrt|ddkr|d rt |d}|d krd |d|d<n d |d|d<d |}|S) z2Clean and fix malformed web dates from QLD websiterBrI rrr$Nr2019) r:rcountrrnowyearr- startswithr^isdigitr/)r<rrr current_yeardecade year_suffixr2r2r3rs*     (  z'SeleniumLicenseSearcher._clean_web_datematching_recordsemployeec s|siSt|dkr|dStdt|dfdd}g}|D](}||}|||ftd|dd |d d |d d |dd| q"|jdddd|dd}|dd}td|d|d d|d d|d|S)zPSelect the best record from multiple matching records based on priority criteriar'rzDEBUG: Evaluating z) matching records to find the best one...csd}|ddkr |d7}n|d7}z8|drH|ddkrH|d}|rHt|d}|tkrD|d 7}|tj}|t|d 7}n|d 7}Wn|d 7}Y|d d}d|vrc|d7}nd|vrk|d 7}|d|d7}|S)Nr match_typeexactiiexpiryrBrim2 license_typerIzSECURITY OFFICERdSECURITY row_index)rrrrdaysminrrU)recordscorecleaned_expiry expiry_datedays_until_expiryrr;r2r3calculate_priority_scores0      zMSeleniumLicenseSearcher._select_best_record..calculate_priority_scorezDEBUG: Record rz - Name: r, Type: r , Expiry: rz , Score: cSs|dSNrr2rVr2r2r3rXsz=SeleniumLicenseSearcher._select_best_record..T)r[reversez"DEBUG: Selected record with score : z - )rrorrsort) r<rrrscored_recordsrr best_record best_scorer2r;r3_select_best_records   &8  ,z+SeleniumLicenseSearcher._select_best_recordcCs~|j|jvr|j|j}||j|j|_d|_|S||}|r=|j ||j|j<Wd|S1s8wY|S)z0Search for one employee's license using SeleniumTN) r7rrr6rCrGrN_search_with_retriesrQr)r<r cached_resultresultr2r2r3search_single_licenses    z-SeleniumLicenseSearcher.search_single_licensec Cs8|jstSd}t|jjD]{}zR|j\}}zAt}| |||}t|}| rT| |j |j |_||j|j|_||_||_|W|j|WSW|j|n|j|wWqty} zt| }||jjdkrtd|dWYd} ~ qd} ~ wwtd|jjd||jjdS)z(Try searching multiple times if it failsrIr'r"Nz Failed after z attempts: )rJrK)r7r:rArprdrrrtime_do_selenium_searchrQrr6rCrGrr8rErHrKrMrrr-sleep) r<r last_errorattemptrur start_timer search_timerr2r2r3rsB   z,SeleniumLicenseSearcher._search_with_retriesrurcCsztd|j||jjtd|jz|tt j df}|j |tdWn t y=tdYnwz|tt jdf}tdWn<t ytdgd }d }|D] }z|tt j|f}td |Wn t yYqbw|std Ynw|||jtd |jz |tjtdWn$z|t jd}|tdWn|d|tdYYtdd} d } gd} | D]#}z|tt j|f} td|d} Wn t yYqw| s|d?d@|d4d5|d6d7|d8dA|dB qLd}g}d}d}|r|#||}|d4}|d8}|d6r|"|d6d}tdC|d5|d6d7|n3tdD|jtdEt!|d dFD]\}}|t j d(}|rtdG|dH|d,jqt|||dWSt y} ztdI| tdJ|jd } ~ wt$y} ztdK| tdLt%| d } ~ wt&y7} ztdM| tdNt%| d } ~ wtyS} ztdO| tdPt%| d } ~ ww)QzQActually search the QLD government website using Selenium with enhanced debuggingzDEBUG: Searching for license: zDEBUG: Loaded page: iframezDEBUG: Switched to iframez1DEBUG: No iframe found, continuing with main page LicenceNumberz DEBUG: Found license input fieldz8DEBUG: Trying alternative selectors for license input...)input[name='LicenceNumber']input[placeholder*='licence']input[placeholder*='license']input[type='text']Nz"DEBUG: Found input with selector: z4Could not find license input field with any selectorzDEBUG: Entered license number: z$DEBUG: Submitted form with Enter keyzFbutton[type='submit'], input[type='submit'], button:contains('Search')z(DEBUG: Submitted form with submit buttonzarguments[0].form.submit();z%DEBUG: Submitted form with JavaScriptzDEBUG: Waiting for results...F)ztable#licenceListztable[id*='licence']ztable[id*='license']ztable[class*='data']tablez*DEBUG: Found results table with selector: TzH*:contains('No results'), *:contains('not found'), *:contains('no data')z#DEBUG: Found 'no results' message: rB)rCrDrEdebug_qld_search_z.pngz,DEBUG: Screenshot saved as debug_qld_search_zCould not find results tablea let dropdown = document.querySelector('select[name="licenceList_length"], select[class*="length"]'); if (dropdown) { dropdown.value = '50'; dropdown.dispatchEvent(new Event('change', { bubbles: true })); console.log('Set dropdown to 50 entries'); } rz&DEBUG: Set dropdown to show 50 entrieszDEBUG: Could not set dropdown: trr'z DEBUG: Found z result rowstdz DEBUG: Row z has insufficient cells: rz license: 'z' vs search: 'rr$r)r7rrrrrz!DEBUG: Exact match found - Name: rrrrrpartialz#DEBUG: Partial match found - Name: z matching recordsz"DEBUG: All matching records found:z z . License: r7z, Name: z , Match: rz$DEBUG: Selected best record - Name: z%DEBUG: No matching license found for z,DEBUG: Available license numbers in results:z Row rzDEBUG: Timeout error: zWebsite timeout for license: zDEBUG: Element not found: zPage element not found: zDEBUG: WebDriver error: zWebDriver error: zDEBUG: General error: zSelenium search error: )'ror7rrdrtitleuntilECpresence_of_element_locatedrTAG_NAME switch_toframerelement_to_be_clickableID CSS_SELECTORrclear send_keysr:rRETURN find_elementclickrtextrAsave_screenshotrr find_elementsr enumeraterrrrr-r)r<rurrr search_inputalternative_selectorsselector submit_button results_foundrtable_selectors no_resultsrrowsrrtrowcells row_licenserweb_nameweb_activitiesr license_foundrr2r2r3r=s<               ""    *    &D   z+SeleniumLicenseSearcher._do_selenium_searchN)r)r*r+r,rrcrnr-rrrrrrrr4rrArrr rrrr2r2r2r3rs )(;#G )rc@s.eZdZdZedededeefddZ dS)SimpleCSVHandlerz"Reads employee data from CSV files file_pathrdr>c sztj|tddjjjdd_gd}fdd|D}|r5tdd |d tjd g} D]9\}}t |d |d |d|d|dd}| | rt| ||jrtt||jkrttd|jdnq;|s{tdg}t} d} |D]}|j| vr| |j| |q| d7} q| dkrtd| d|WSty} z tdt| d} ~ ww)z Load employee data from CSV fileF)dtype na_filterurI)Payroll Number Employee NameLicense NumberExpiry/Update Datecsg|] }|jvr|qSr2)columns)rcoldfr2r3r(sz7SimpleCSVHandler.load_employee_data..z" ERROR: Missing required columns: r\z Your CSV file MUST have these exact column names: - Payroll Number - Employee Name - License Number - Expiry/Update Date Current columns in your file: z r2r3r4r5rr5r6r7r8r9z!TEST MODE: Processing only first  recordsz2ERROR: No valid employee records found in CSV filerr'zNOTE: Removed z duplicate license numberszERROR reading CSV file: N)pdread_csvr-r6r:replace ValueErrorr^listiterrowsr4r=r?rrr&rr(rosetr7addr) r/rdrequired_columnsmissing_columns employeesindexr(runique_employees seen_licensesduplicates_removedrr2r8r3load_employee_datasZ       z#SimpleCSVHandler.load_employee_dataN) r)r*r+r, staticmethodr-rrr4rKr2r2r2r3r. r.c@steZdZdZdefddZddZdedefd d Z dd e d ede fddZ de de fddZ de de fddZdS)SimpleProgressTrackerz1Shows nice progress bar and processing statisticstotal_employeescCs<||_d|_d|_d|_d|_t|_d|_t |_ dSr) rO completed successfulfailedcachedrr last_updaterkrlrm)r<rOr2r2r3rnls zSimpleProgressTracker.__init__c Csdtddtd|jdtdtddddd dd ddd d dd tddS)zShow the processing header U=====================================================================================z!QLD LICENSE CHECKER - PROCESSING z EMPLOYEESProgress<15rEmployee<25LicenseStatus<12SpeedzU-------------------------------------------------------------------------------------N)rorOr;r2r2r3 show_headervs  ,z!SimpleProgressTracker.show_headerrrc Csl|j-|jd7_|jr|jd7_n|r"|jd7_n|jd7_Wdn1s3wYt}||jdkrEdS||_|j|j d}| |}t ||j d}|j|d}t |jdkrt|jddd n|j}t |jd kr|jdd d n|j} |jrd } n |rd } nd} td|d|dd| dd| dd|dd ddddS)zUpdate progress displayr'Nr"rg{Gz?<z..r CachedSuccessFailed rrZrXr].0fz/minrIT)endflush)rmrPrNrSrQrQrRrrTrO_make_progress_barrrrr6r7ro) r<rr current_timepercent progress_barelapsedspeed display_namedisplay_licensestatusr2r2r3update_progress~sN  . z%SimpleProgressTracker.update_progressr rmwidthr>cCs8t||d}d|d||}d|d|ddS)zCreate ASCII progress barrXr[z] z5.1f%r/)r<rmrufilledbarr2r2r3rksz(SimpleProgressTracker._make_progress_bar elapsed_timeexcel_file_pathcCstddtdtdtd|jtd|jtd|jtd|jtd|jt|jd d d d td ||td|j|dd dtd|tddS)zShow final processing summaryz rVzPROCESSING COMPLETED!zTotal employees processed: zSuccessful searches: zFailed searches: zCached results: zSuccess rate: r'rrrxz Total time: zProcessing speed: r`z employees/minutezExcel report saved: N)rorPrQrRrSr _format_time)r<r|r}r2r2r3show_final_summarys $z(SimpleProgressTracker.show_final_summarysecondscCsp|dkr |ddS|dkr"t|d}t|d}|d|dSt|d}t|dd}|d|dS) z"Convert seconds to readable formatr`rhz secondsizm szh mry)r<rminutessecshoursr2r2r3r~s    z"SimpleProgressTracker._format_timeN)r )r)r*r+r,r/rnr_r4rArtr0r-rkrr~r2r2r2r3rNis ,rNc@s.eZdZdZedeededefddZdS)SimpleExcelGeneratorz'Creates Excel reports with color codingresultsoriginal_file_pathr>c Csz@t|}td}|j|jd|d}g}|D]W}|dd}|dd}|dd} |dd} |d kpl|d kpl|d kpl|d pl|d kpl|d kpl| d kpl| d kpl| d kpl| d kpl| dpld| vpld| v} | rt||q|sdddt |ddddddd } | g}|j|jd|d}t |} t j |dd}t |dksdt |dd dvrd!nd"}| j|d#|d$|j}|j|}|d%d&d'dd(d)d%d*}t| jD]5\}}|d|||tt t || js| |t j nd}tt|d+d,d-}||||q|dd.|ddt | t | jd|ddWd/n 1s8wYt |WStyX}z td0t |d/}~ww)1zDCreate Excel report - EXCEPTIONS ONLY (problems that need attention)z %Y%m%d_%H%M%S _Exceptions_z.xlsx Name MatchrI Licence NameLicence Type(s) Expiry StatusrBrFErrorrrzError:z Date WrongrzN/Az"ALL RECORDS PROCESSED SUCCESSFULLYr;z No exceptionsz All foundz All validzAll dates matchz All active r2zLicence Number Rolecall NamerrrzLicence ExpiryzRolecall Expiryr_QLD_ALL_SUCCESS_ xlsxwriter)enginer'z ALL RECORDSrr ExceptionszProcessing SummaryF)rG sheet_nameTz#8C1E31whitecentervcenter)boldbg_color font_colorborderalignvalign text_wrapr$ rr NzERROR creating Excel report: )rrrstrftimeparentstemrrrrrr< DataFrame ExcelWriterr-to_excelbooksheets add_formatrr6writeremptyastyper set_columnset_row autofilter freeze_panesrro)rr original_path timestamp excel_pathexception_resultsr name_match licence_name licence_typesrH is_exceptionsummary_resultr9writerrworkbook worksheet header_colorcol_numheader max_length col_widthrr2r2r3create_excel_reports                   )z(SimpleExcelGenerator.create_excel_reportN) r)r*r+r,rLrrr-rr2r2r2r3rrMrc@steZdZdZddZddZddZdefd d Zd e de fd d Z de e de efddZdedefddZdS)SeleniumQLDLicenseCheckerz0Main application class - using reliable SeleniumcCst|_t|j|_d|_dSrO)rrdrcrprogress_trackerr;r2r2r3rnCs  z"SeleniumQLDLicenseChecker.__init__c Cs4zz?||}t||j}|t|s%tdWW|j dS| |}t ||}t |jj}|j||Wn;tyMtdYn7ty{}z#tdt|tdtdtdtdtd WYd}~nd}~wwW|j dSW|j dSW|j dS|j w) z0Main function - this is where everything happenszProcess cancelled by userNz* Process stopped by user (Ctrl+C pressed)z ERROR: z TROUBLESHOOTING TIPS:z1. Make sure your CSV file has the exact column names: 'Payroll Number', 'Employee Name', 'License Number', 'Expiry/Update Date'z)2. Check that Chrome browser is installedz)3. Make sure you have internet connectionz<4. Try running as administrator if you get permission errors) _show_welcome_get_csv_file_from_userr.rKrd_ask_user_to_continuerrorr_process_all_employeesrrrrrrKeyboardInterruptrr-)r< csv_file_pathrFrrr|rr2r2r3runHs>     zSeleniumQLDLicenseChecker.runcCs tddS)zShow welcome messagez!QLD License Checker - Starting...N)ror;r2r2r3rps z'SeleniumQLDLicenseChecker._show_welcomer>cCsttjdkrtjdd}td|ntdtdtdtdtdtd d}|sszDSeleniumQLDLicenseChecker._process_all_employees..rzERROR processing rrrJN)rNrrrrdrrr%r rr5r7r6rCrGrarEr8rHrrrtrrr#rror-rA) r<rF all_resultsfuture_to_employeefuturer search_result result_dictr error_resulterror_search_resultr2rr3rs\     <c szt|j}|sgWStt|}g}tjjdfdd|D}t|D]~}||}z<| }|j |j |j |j |j|||j|j|j|j|j|j|j|d} || |||tjjWq/ty} z0|j |j |j ddddd|jddddt| dd} || t t| d } ||| WYd } ~ q/d } ~ wwWd |WS1swY|WSty} zd t| dd gWYd } ~ Sd } ~ ww) zKProcess CSV file and return results as JSON-compatible list of dictionariesrci|] }jj||qSr2rrrrrr<r2r3ryz9QLDLicenseCheckerAPI.process_csv_file..r5r7r6rCr license_typesprimary_licenserEr8rHrMretriesrNrJrQrrLrFrNzCSV processing failederrormessagerQ)!rr.rKrdrNrrr%r rr5r7r6rCrGrarbrEr8rHrMrKrNrJrQrrrtrrr#rr-rA) r<rrFrrrrrrrrrrr2rr3process_csv_filefs       DDz%QLDLicenseCheckerAPI.process_csv_filec CsXztr dddWSdddWSty+}zddt|dWYd}~Sd}~ww) z0Test connection to QLD website and return statussuccessz"QLD website connection test passed)rsrwarningz=QLD website connection test failed - website may have changedrzConnection test failed: N)rrr-)r<rr2r2r3test_connections z$QLDLicenseCheckerAPI.test_connectioncCs0|jj|jj|jj|jj|jj|jj|jjdS)z"Get current configuration settings)rrrr!r#r%r&)rdrrrr!r#r%r&r;r2r2r3 get_configszQLDLicenseCheckerAPI.get_config records_datacszH|rtdt|dtd|dg}t|D]m\}}d}gd}|D] }||vr:|}nq0|sNtd|dt|d}nt||d}td |d |d |tt|d dt|d dt|dd||dd} | | | q$|sgWSt t |} g} t jjdfdd|D} t| D]} | | } z<| }| j| j| j|j|j|||j| j|j|j|j|j|j| d}| || !| |t"#jj$Wqt%y4}z0| j| j| jddddd| jddddt|dd}| |t&t|d}| !| |WYd}~qd}~wwWd| WS1sBwY| WSt%ye}zdt|ddgWYd}~Sd}~ww)zRProcess list of records and return results as JSON-compatible list of dictionariesz'DEBUG: Available keys in first record: rzDEBUG: First record data: N)r5zExpiry/Update Datez Expiry DateExpiryr8rz%DEBUG: No expiry key found in record z, available keys: rIzDEBUG: Using key 'z' with value 'z ' for record r2r3r4r'r:rcrr2rrrr2r3rrz8QLDLicenseCheckerAPI.process_records..rrrLFrzRecords processing failedr)'rror@keysrr-rr:r4r=rrrNrrrdr%r rr5r7r6rCrGrarbrEr8rHrMrKrNrJrQrtrrr#rrA)r<rrFrt record_data expiry_key possible_keysr[ expiry_valuerrrrrrrrrrr2rr3process_recordss         DDz$QLDLicenseCheckerAPI.process_recordscCs$|jr|jd|_d|_dSdS)zsZ          0^8OhoEQ"*