*6i'SrSSKrSSKrSSKJr SSKrSSKJr SSKJr SSK r SSK r SSK r \RRS\"\"\5R$R$55 SSKJr SrS\4S jr\S :XaC\R0"S S 9r\R5SS S9 \R75r\"\R:5 gg)uZ Extracts only road features (highways, streets, etc.) from an OpenStreetMap .pbf file downloaded from Geofabrik. ✅ Features: - Automatic folder creation pe except MemoryError as e: print(f"❌ Memory error during extraction: {e}") print("🔄 Attempting regional processing...") roads = extract_roads_by_regions(filename, location_dir, location) if roads is None: print("💡 Regional processing failed. Try processing a smaller country/region") sys.exit(1)ion - Saves standardized GeoPackage to: output/{LOCATION}/{location}_roads.gpkg N)Path)tqdm)OSM)get_geofabrik_urlc SSKnSSKJn [S5 [ [ U55nUR 5nURn[SU35 UuppX- S- n X- S- n /n[S5Hn[S5HnXU --nXS-U --nU UU --nU US-U --nUUUU4n[SUS-S US-S U35 [ [ U5[U5S 9nURS S 0SSS/SQS9nUbGUR(d6[S[U5SSUS-S US-35 URU5 O[SUS-S US-35 UR5 M GM U(aO[S5 [ R""[$R&"US S95n[S[U5SS35 U$g![a&n[SUS-S US-SU35 SnAGMwSnAff=f)z9Extract roads by processing geographic regions separatelyrN)boxu9🏗️ Processing large dataset by geographic regions...u📍 Dataset bounds: u🔍 Processing region -z/16: ) bounding_boxhighwayTkeepF r namelaneswidthsurfacematerialbridgetunnellayer custom_filter filter_type keep_nodeskeep_relationsextra_attributesu ✅ Found ,z roads in region u ⚪ No roads in region u ❌ Error in region : u� Combining all regions...) ignore_indexu✅ Total extracted: z roads from all regions)gcshapely.geometryrprintrstrget_boundaries total_boundsrangelistget_data_by_custom_criteriaemptylenappendcollect Exceptiongpd GeoDataFramepdconcat)filename location_dirlocationr!rosmboundaries_gdfboundsmin_lonmin_latmax_lonmax_latlon_steplat_step all_roadsijregion_min_lonregion_max_lonregion_min_latregion_max_lat region_bbox region_osm region_roadsecombined_roadss '/data2/heatmap/scripts/extract_roads.pyextract_roads_by_regionsrL#sN $ EF c(m C'')N  ( (F !& *+*0&Gg!Q&H!Q&HI 1XqA% !(xG99G>r5c | UR5n[R"5nUS- U- nURSSS9 X S3- nUS- n[ U5n[ SU35 UR5(Gd[ S UR5S 35 [R"WSS S 9nUR5 [URRS S55nSn [!US5n [#USSSUS3S9n UR%U S9H.n U R'U 5 U R)[+U 55 M0 SSS5 SSS5 SSS5 UR-5R.S:a [ S5e[ SU35 O[ SU35 [ S5 Sn UR-5R.S- n[ SUSS35 US:nU(a=[ S US!S"35 [3X2U5n U bU R4(a [ S#5eO[7[9U55n[ S%5 UR;S&S0S'S(S(/S)QS*9n U bU R4(a [ S+5e[ S,[+U 5S-S.UR5S/35 [ S0U R=SS19R?5S- SS35 U RCS6S79n [ S85 X S:3- nU REUS;SU35 S(nU(a>UR5(a)URG5 [ S@URH35 O[ SAUSB35 [ SE5 [ SFU35 [ SGURH35 [ SHURH35 [ SI[+U 5S-35 [ SJ5 [ U RK55 g![ a/n[ SU35 [R"S5 SnAGNSnAff=f!,(df  GN=f!,(df  GN=f!,(df  GN=f![0a/n[ SU35 [R"S5 SnAGNSnAff=f![0a/n[ S$U35 [R"S5 SnAGNSnAff=f![@an[ S2U35 [ S35 [3X2U5n U bU R4(a [ S#5eSnAGN_![0a3n[ S4U35 [R"S5 SnASnAGNSnAff=fSnAf[0a/n[ S5U35 [R"S5 SnAGNSnAff=f![0an[ S9U35 SnAGNSnAff=f![0a/n[ S?U35 [R"S5 SnAGNSnAff=f![0an[ SCUSDU35 SnAGNSnAff=f)KNoutputT)parentsexist_okz.osm.pbfz data.gpkgu🔗 Geofabrik URL: u❌ r u ⬇️ Downloading OSM data for z... x)streamtimeoutzcontent-lengthri wbBi)totalunit unit_scale unit_divisordesc) chunk_sizeiu<Downloaded file seems too small — possible download error.u ✅ Download complete: u✅ Found existing file: u❌ Download failed: u 🚧 Extracting roads...iu📊 PBF file size: z.1fz MBiu💡 Large file detected (z.0fz- MB) - using chunked extraction with 6x6 gridz#Chunked extraction returned no datau❌ Chunked extraction failed: u🔍 Reading OSM metadata...r rFrrzNo road data extractedu✅ Extracted rz roads from z data.u📊 Memory usage: )deepu❌ Memory error: u%🔄 Attempting chunked extraction...u$❌ Chunked extraction also failed: u❌ Road extraction failed: i)epsgu&🌐 Reprojected to WGS84 (EPSG:4326).u⚠️ Reprojection failed: z _roads.gpkgroadsGPKG)rdriveru💾 Saved extracted roads to: u❌ Saving failed: u!🧹 Deleted processed PBF file: u+📦 Kept PBF files (DELETE_DOWNLOADED_PBF=)u⚠️ Could not delete ru ✅ Process complete!u 📁 Folder: u 📥 Input: u 💾 Output: u🛣️ Roads extracted: z<------------------------------------------------------------)&lowerrcwdmkdirrr# ValueErrorsysexitexists capitalizerequestsgetraise_for_statusintheadersopenr iter_contentwriteupdater+statst_sizer.rLr*rr$r) memory_usagesum MemoryErrorto_crsto_fileunlinkrhead)r5base_dirr4r3 output_pathurlrIr total_size block_sizefbarchunkr^ file_size_mb use_chunkedr6chunk_eDELETE_DOWNLOADED_PBFs rK extract_roadsrms~~HxxzHh&1Ltd3 (33H,K) $SE*+  4X5H5H5J4K5Q Rc$<""$ /?!CD ! (D)Q$#!%$:X. 1 !":!F 3u:."G1) = }}&&3 !_`` -hZ8 9 -hZ8 9 &' E==?**i8L c 2# 67$K *<*<": X__%6%6 OO  5hmm_E F ?@U?VVWX Y #$ M, () L () M+**+ ,- %c%j^ 45 (O %**,S  QCj  11)) =<*  %aS)*  .  3A37 8 HHQKK 4  &qc* + 9 : 0R=EKK$%JKK%0 $U,"U4,U11U44 V0$V++V03 W=WW X#$X  X X;X66X;__main__z2Download and extract OSM road data for a location.) descriptionz/Location name (e.g., alabama, egypt, thailand).)help)__doc__argparserfpathlibrrjrpyrosmr geopandasr/pandasr1ospathinsertr$__file__parentscripts.geofabrik_registryrrLr__name__ArgumentParserparser add_argument parse_argsargsr5rKrs   3tH~,,33458 ETVCVr z  $ $HF  )Z[    D$-- r