opengrapher-useragent

Opengrapher

utility for parsing the Open Graph tags from url

(read more about the specification at http://ogp.me/)

Installation

   $ pip install opengrapher

Usage

   >>> import opengrapher
   >>> opengrapher.parse('https://www.imdb.com/title/tt0110912')
   {
      "url": "https://www.imdb.com/title/tt0110912",
      "title": "Pulp Fiction (1994) - IMDb",
      "type": "video.movie",
      "image": "https://m.media-amazon.com/images/M/MV5BNGNhMDIzZTUtNTBlZi00MTRlLWFjM2ItYzViMjE3YzI5MjljXkEyXkFqcGdeQXVyNzkwMjQ5NzM@._V1_UY1200_CR97,0,630,1200_AL_.jpg",
      "description": """
         Directed by Quentin Tarantino.  With John Travolta, Uma Thurman,
         Samuel L. Jackson, Bruce Willis. The lives of two mob hitmen,
         a boxer, a gangster and his wife, and a pair of diner bandits
         intertwine in four tales of violence and redemption.
      """,
   }

List of parsing tags is stored in PARSE_TAGS constant

   >>> from opengrapher import PARSE_TAGS
   >>> PARSE_TAGS
   ["url", "title", "type", "image", "description"]

You can pass a specific list of tags to parse function if you want:

   >>> import opengrapher
   >>> custom_tags = ['url', 'title']
   >>> opengrapher.parse('https://www.imdb.com/title/tt0110912', parse_tags=custom_tags)
   {
      "url": "https://www.imdb.com/title/tt0110912",
      "title": "Pulp Fiction (1994) - IMDb",
   }

You can also pass a custom user-agent header to be used when fetching the url, in the event that the site blocks generic python-requests user-agent strings:

>>> import opengrapher
>>> user_agent = "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.135 Safari/537.36 Edge/12.246"
>>> opengrapher.parse('https://www.imdb.com/title/tt0110912', user_agent=user_agent)
{
   "url": "https://www.imdb.com/title/tt0110912",
   "title": "Pulp Fiction (1994) - IMDb",
}

Note that all tags will be transformed to "og:{tag}" format, as it stated in opengraph notation