Extract and Enhance Scrapy Spider Item Details

  • Share this:

Code introduction


This function extracts information from a Scrapy spider's item and adds additional fields such as rating and description.


Technology Stack : Scrapy, Python Dictionary

Code Type : Scrapy Item Parsing Function

Code Difficulty : Intermediate


                
                    
def parse_item(item):
    # Extract the title and price from the item
    title = item['title']
    price = item['price']
    # Create a new dictionary with additional information
    item_with_details = {
        'title': title,
        'price': price,
        'rating': item['rating'],
        'description': item['description'],
        'url': item['url']
    }
    return item_with_details