You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
boB Rudis 6c196ac543
one more try for ubuntu
6 years ago
R initial commit 6 years ago
man trying for ubuntu 6 years ago
src one more try for ubuntu 6 years ago
tests initial commit 6 years ago
.Rbuildignore initial commit 6 years ago
.gitignore initial commit 6 years ago
.travis.yml initial commit 6 years ago
CONDUCT.md initial commit 6 years ago
DESCRIPTION trying for ubuntu 6 years ago
LICENSE initial commit 6 years ago
NAMESPACE trying for ubuntu 6 years ago
README.Rmd README 6 years ago
README.md README 6 years ago
htmltidy.Rproj initial commit 6 years ago

README.md

htmltidy — Clean up gnarly HTML/XML

Inspired by this SO question and because there's a great deal of cruddy HTML out there that needs fixing to use properly when scraping data.

NOTE: Requires libtidy and presently is super-basic (no way to set options and pretty much only does HTML)

brew install tidy-html5 on OS X to get this to work. You'll have to do a bit more leg-work to get it to work on linux (apt-get install libtidy-dev on Ubuntu sticks the library in a tidy subdir off /usr/lib and I don't have a configure script setup yet).

SEEKING COLLABORATORS

This works enough for me to use in a pinch. It should be straightforward (but tedious) to:

  • enable passing options in a list
  • bundle libtidy with the package and get it to work on Windows, linux & MacOS as the library compiles on all three with the necessary tools.

The following functions are implemented:

  • tidy : Clean up gnarly HTML/XML

Installation

devtools::install_github("hrbrmstr/htmltidy")

Usage

library(htmltidy)

# current verison
packageVersion("htmltidy")
#> [1] '0.0.0.9000'

cat(tidy("<b><p><a href='http://google.com'>google &gt</a></p></b>"))
#> <!DOCTYPE html>
#> <html xmlns="http://www.w3.org/1999/xhtml">
#> <head>
#> <meta name="generator" content=
#> "HTML Tidy for HTML5 for Mac OS X version 5.2.0" />
#> <title></title>
#> </head>
#> <body>
#> <p><b><a href='http://google.com'>google &gt;</a></b></p>
#> </body>
#> </html>

Code of Conduct

Please note that this project is released with a Contributor Code of Conduct. By participating in this project you agree to abide by its terms.