Four Exercises to Practice Our Web-Scraping and API-Calls

SICSS-Oxford

Tuesday 15-06-2021

Question 1A. (Basic): Scrape and print out a quote from the Simpsons API.

import requests
import json
import pandas as pd
import seaborn as sns

def get_api(url):
    api_return = requests.get(url)
    if api_return.status_code==200:
        api_text = json.loads(api_return.text)
    return api_text[0]['quote']

url = 'https://thesimpsonsquoteapi.glitch.me/quotes'
api_quote = get_api(url)
print(api_quote)

Can't we have one meeting that doesn't end with us digging up a corpse?

Question 1B. (Advanced): How many quotes are on the API?

from tqdm.notebook import tqdm_notebook
df = pd.DataFrame(index=range(0, 2000), columns=['uniq_count'])
quote_set = set()
counter = 1
for quote in tqdm_notebook(df.index):
    if get_api(url) not in quote_set:
        quote_set.add(get_api(url))
        df.at[quote, 'uniq_count'] = counter
        counter = counter + 1
    else: 
        df.at[quote, 'uniq_count'] = counter
df.plot()
# can you think of a faster way to do this? maybe a different api call?

<AxesSubplot:>

print(quote_set)

{"I'm sleeping in the bath tub.", "That's where I saw the leprechaun...He told me to burn things.", "I hope I didn't brain my damage.", 'Shoplifting is a victimless crime, like punching someone in the dark.', "All I'm gonna use this bed for is sleeping, eating and maybe building a little fort.", 'For once maybe someone will call me "sir" without adding, "You\'re making a scene."', "Me fail English? That's unpossible.", 'Last night\'s "Itchy & Scratchy" was, without a doubt, the worst episode ever. Rest assured that I was on the Internet within minutes, registering my disgust throughout the world.', "Oh boy, sleep! That's where I'm a viking!", 'Oh Yeah!', "When I catch you, I'm gonna pull out your eyes and stick 'em down your pants so you can watch me kick the crap outta you, okay? Next I'm gonna use your tongue to paint my boat!", 'Why are you pleople avoiding me? Does my withered face remind you of the grim specter of death?', "Hello, Simpson. I'm riding the bus today becuase Mother hid my car keys to punish me for talking to a woman on the phone. She was right to do it.", 'Eat my shorts', 'In theory, Communism works! In theory.', 'Ah, be creative. Instead of making sandwhiches with bread, use Pop-Tarts. Instead of chewing gum, chew bacon.', 'Oh, so they have Internet on computers now!', 'Remember the time he ate my goldfish? And you lied and said I never had a goldfish. Then why did I have the bowl, Bart? Why did I have the bowl?', "But my mom says I'm cool.", 'Ahh! Sweet liquor eases the pain.', "Can't we have one meeting that doesn't end with us digging up a corpse?", "You're turning me into a criminal when all I want to be is a petty thug.", "Shut up, brain. I got friends now. I don't need you anymore.", "Last night's 'Itchy and Scratchy' was, without a doubt, the worst episode ever. Rest assured that I was on the Internet within minutes, registering my disgust throughout the world.", 'And this is the snack holder where I can put my beverage or, if you will, cupcake.', "Oh, wow, windows. I don't think I could afford this place.", 'Back in Edinburg, we had a coal miners strike. All we wanted were hats with a wee light on top. Then one day the mine collapsed. No one made it out alive, not even Willie!', "Nothing you say can upset us. We're the MTV generation.", "I don't want to sound like a killjoy, but becuase this is not to my taste I don't think anyone else should be allowed to enjoy it.", "These are my only friends...grown-up nerds like Gore Vidal. And even he's kissed more boys than I ever will.", 'Yeah. Call this an unfair generalization if you must.. but old people are no good at everything', 'Inflammable means flammable? What a country!', 'I believe the children are the future... Unless we stop them now!', 'My eyes! The goggles do nothing!', "When I look at people I don't see colors; I just see crackpot religions.", 'By chilling my loins I increase the chances of impregnating my wife.', "I can't even say the word 'titmouse' without gigggling like a schoolgirl.", 'They taste like...burning.', "Facts are meaningless. You could use facts to prove anything that's even remotely true.", 'Thank you. Come again.', 'Gah, stupid sexy Flanders!', "I think women and seamen don't mix", 'Hi, Super Nintendo Chalmers!', "Doughnuts? I told you I don't like ethnic food", 'Marriage is like a coffin and each kid is another nail.', 'I live in a single room above a bowling alley...and below another bowling alley.', "I used to be with it. But then they changed what it was. Now what I'm with isn't it, and what's it seems scary and wierd. It'll happen to you.", "Hey, I'm the chief here. Bake him away, toys."}

Question 2A. (Basic): Scrape a picture of a cat from thecatapi and programatically show it in an ipynb or rmd file.

import io
import imageio
from PIL import Image

url = 'https://api.thecatapi.com/v1/images/search'

def get_cat(url):
    api_return = requests.get(url)
    if api_return.status_code==200:
        api_text = json.loads(api_return.text)
        cat_url = api_text[0]['url']
        r = requests.get(cat_url)
        return Image.open(io.BytesIO(r.content))
get_cat(url)