60 research outputs found
qdap-tm Package Compatibility
The qdap package (Rinker, 2013) is an R package designed to assist in quantitative discourse analysis. The package stands as a bridge between qualitative transcripts of dialogue and statistical analysis and visualization. The tm package (Feinerer and Hornik, 2014) is a major R (R Core Team, 2013) package used for a variety of text mining tasks. Many text analysis packages have been built around the tm package’s infrastructure (see CRAN Task View: Natural Language Processing). As qdap aims to act as a bridge to other R text mining analyses it is important that qdap provides a means of moving between the various qdap and tm data types. This vignette serves as a guide towards navigating between the qdap and tm packages. Specifically, the two goals of this vignette are to (1) describe the various data formats of the two packages and (2) demonstrate the use of qdap functions that enable the user to move seamlessly between the two packages. 1
qdapDictionaries: qdapDictionaries Version 1.0.5
<a class="anchor" href="#news-"><span class="octicon octicon-link"></span></a>NEWS
<a class="anchor" href="#versioning"><span class="octicon octicon-link"></span></a>Versioning
<p>Releases will be numbered with the following semantic versioning format:</p>
<p><major>.<minor>.<patch></p>
<p>And constructed with the following guidelines:</p>
<ul>
<li>Breaking backward compatibility bumps the major (and resets the minor
and patch)</li>
<li>New additions without breaking backward compatibility bumps the minor
(and resets the patch)</li>
<li>Bug fixes and misc changes bumps the patch</li>
</ul>
<a class="anchor" href="#qdapdictionaries-105"><span class="octicon octicon-link"></span></a>qdapDictionaries 1.0.5
<p><strong>BUG FIXES</strong></p>
<ul>
<li><p>contractions did not contain "we've" but erroneously contained "what did"
rather than "what'd" and "when" rather than "when'd" = "when did".</p></li>
<li><p>The data sets emoticon and abbreviations had the columns stored as factor.<br>
These columns have been changed to character.</p></li>
</ul>
<p><strong>NEW FEATURES</strong></p>
<ul>
<li><p>function.words a list of function words added from: <a href="http://myweb.tiscali.co.uk/wordscape/museum/funcword.html">http://myweb.tiscali.co.uk/wordscape/museum/funcword.html</a></p></li>
<li><p>discourse.markers.alemany a list of Aalemany's (2005) discourse markers
added from: <a href="http://www.cs.famaf.unc.edu.ar/%7Elaura/shallowdisc4summ/tesi_electronica.pdf">http://www.cs.famaf.unc.edu.ar/~laura/shallowdisc4summ/tesi_electronica.pdf</a></p></li>
</ul>
<p><strong>CHANGES</strong></p>
<ul>
<li>The <strong>qdap</strong> package is no longer in Suggests: in the DESCRIPTION file.</li>
</ul>
<a class="anchor" href="#qdapdictionaries-102"><span class="octicon octicon-link"></span></a>qdapDictionaries 1.0.2
<p><strong>BUG FIXES</strong></p>
<ul>
<li>
key.syn contained antonyms and elements that were error messages (character).
This has been fixed. Reference <a href="https://github.com/trinker/qdapDictionaries/issues/2">issue #2</a>. (Jingjing Zou)</li>
</ul>
<p><strong>NEW FEATURES</strong></p>
<ul>
<li>
GradyAugmented was added. This augmented Grady data set is a large list of
known English words and proper nouns.</li>
</ul>
<p>IMPROVEMENTS</p>
<ul>
<li>
contractions data set picks up 3 words: "it'll", "'cause", & "there'll".</li>
</ul>
<a class="anchor" href="#qdapdictionaries-100---101"><span class="octicon octicon-link"></span></a>qdapDictionaries 1.0.0 - 1.0.1
<p>The removal of environments and addition of keys (name change from env.XXX to
key.XXX) may cause a break with backward compatibility, hence the major version
bump to 1.0.0.</p>
<p><strong>CHANGES</strong></p>
<ul>
<li>The env.syl, env.pol, env.power, env.strength, and env.syn have been
converted from environments to data.table based hash keys and renamed to
key.syl, key.pol, key.power, key.strength, and key.syn.</li>
</ul>
<a class="anchor" href="#qdapdictionaries-004"><span class="octicon octicon-link"></span></a>qdapDictionaries 0.0.4
<p><strong>NEW FEATURES</strong></p>
<ul>
<li> The following sentiment related data sets have been added: strong.words,
weak.words, power.words, submit.words, env.strength, env.power.</li>
</ul>
<a class="anchor" href="#qdapdictionaries-002"><span class="octicon octicon-link"></span></a>qdapDictionaries 0.0.2
<p>First version sent to CRAN</p>
<a class="anchor" href="#qdapdictionaries-001"><span class="octicon octicon-link"></span></a>qdapDictionaries 0.0.1
<p>The dictionaries and word lists previously found in <strong>qdap</strong> have been moved to a separate package, <a href="https://github.com/trinker/qdapDictionaries">qdapDictionaries</a>. This is the first instalment of the package.</p>
qdapRegex: qdapRegex version 0.4.0
<a class="anchor" href="#news-"><span class="octicon octicon-link"></span></a>NEWS
<a class="anchor" href="#versioning"><span class="octicon octicon-link"></span></a>Versioning
<p>Releases will be numbered with the following semantic versioning format:</p>
<p><major>.<minor>.<patch></p>
<p>And constructed with the following guidelines:</p>
<ul>
<li>Breaking backward compatibility bumps the major (and resets the minor
and patch)</li>
<li>New additions without breaking backward compatibility bumps the minor
(and resets the patch)</li>
<li>
<p>Bug fixes and misc changes bumps the patch</p>
<a class="anchor" href="#qdapregex-040"><span class="octicon octicon-link"></span></a><a href="https://github.com/trinker/qdapRegex">qdapRegex</a> 0.4.0
</li>
</ul>
<p><strong>BUG FIXES</strong></p>
<ul>
<li><p>rm_number did not extract consecutive digits that aren't comma separated
without separating it into multiple strings. For example "12345" became
"123" "45". Also 444,44 will not be removed/extracted as it is not a valid
comma separated number. These behavior have been corrected and the unit test
now include these cases. Thanks to Jason Gray for the reworked of the regex.
It is simpler and more accurate.</p></li>
<li><p>rm_between did not handle quotation marks (") as both the left and right
boundary when extract = TRUE. Bug reported by Tori Shannon,
<a href="http://stackoverflow.com/q/31119989/1000343,"></a><a href="http://stackoverflow.com/q/31119989/1000343">http://stackoverflow.com/q/31119989/1000343</a>, and addressed by Jason Gray. See
<a href="https://github.com/trinker/qdapRegex/issues/13">issue #13</a></p></li>
</ul>
<p><strong>NEW FEATURES</strong></p>
<ul>
<li><p>as_numeric & as_numeric2 added for use with rm_number. These are
wrappers for as.numeric(gsub(",", "", x)). The former removes commas and
converts a list of vectors of strings to numeric. The later wraps
as_numeric with unlist.</p></li>
<li><p>rm_non_words added to remove every any character that isn't a letter,
apostrophe, or single space.</p></li>
<li><p>The class extracted has been added and is the output of a rm_xxx function
when extract = TRUE. This allows for the c.extracted function to easily
turn the list output into a character vector.</p></li>
<li><p>c.extracted added to provide a quick unlist method for lists of class
extracted. The is less typing than unlist for an approach that is used
often.</p></li>
<li><p>bind_or added as a means of quickly wrapping multiple sub-expression
elements with left/right boundaries and then concatenate/joins the grouped
strings with regular expression or statement ("|").</p></li>
</ul>
<p><strong>MINOR FEATURES</strong></p>
<ul>
<li>
punctuation added to regex_supplement dictionary for easy negation of
[:punct:] class.</li>
</ul>
<p><strong>IMPROVEMENTS</strong></p>
<p><strong>CHANGES</strong></p>
<a class="anchor" href="#-qdapregex-021---032"><span class="octicon octicon-link"></span></a> <a href="https://github.com/trinker/qdapRegex">qdapRegex</a> 0.2.1 - 0.3.2
<p><strong>BUG FIXES</strong></p>
<ul>
<li><p>explain used message to print to the console. explain now returns an
object of the class explain with its own print method which uses cat
rather than message. Additionally, the characters + and & were not
handled correctly; this has been corrected.</p></li>
<li><p>Documentation for TC "there is an incomplete sentence. It is as follows:
TC utilizes additional rules for capitalization beyond stri_trans_totitle
that includes..." (found by rmsharp). This has been corrected. See <a href="https://github.com/trinker/qdapRegex/issues/8">issue #8</a></p></li>
<li><p>cheat (and accompanying regex_cheat dictionary) contained misspellings in
the words <em>greedy</em> and <em>beginning</em>. This has been corrected.</p></li>
<li><p>rm_number incorrectly handled numbers containing leading or trailing zeros.
See <a href="https://github.com/trinker/qdapRegex/issues/9">issue #9</a></p></li>
<li><p>rm_caps_phrases could only extract/remove up to two "words" worth of capital
letter phrases at a time. See <a href="https://github.com/trinker/qdapRegex/issues/11">issue #11</a></p></li>
</ul>
<p><strong>NEW FEATURES</strong></p>
<ul>
<li><p>%+% binary operator version of pastex(x, y, sep = "") added to join
regular expressions together.</p></li>
<li><p>group_or added as a means of quickly wrapping multiple sub-expression
elements with grouping parenthesis and then concatenate/joins the grouped
strings with regular expression or statement ("|").</p></li>
<li><p>rm_repeated_characters added for removing/extracting/replacing words with
repeated characters (each repeated > 2 times). Regex pattern comes from:
StackOverflow's vks (<a href="http://stackoverflow.com/a/29438461/1000343)."></a><a href="http://stackoverflow.com/a/29438461/1000343">http://stackoverflow.com/a/29438461/1000343</a>).</p></li>
<li><p>rm_repeated_phrases added for removing/extracting/replacing repeating
phrases (> 2 times). Regex pattern comes from:
StackOverflow's BrodieG (<a href="http://stackoverflow.com/a/28786617/1000343)."></a><a href="http://stackoverflow.com/a/28786617/1000343">http://stackoverflow.com/a/28786617/1000343</a>).</p></li>
<li><p>rm_repeated_words added for removing/extracting/replacing repeating words
(> 2 times). </p></li>
</ul>
<p><strong>MINOR FEATURES</strong></p>
<ul>
<li>
run_split regex added to the regex_supplement dictionary to split runs
into chunks.</li>
</ul>
<p><strong>IMPROVEMENTS</strong></p>
<ul>
<li><p>Regular Expression Dictionaries (e.g., regex_usa and regex_supplement) are
now managed with the <strong>regexr</strong> package. This enables cleaner updating of the
regular expressions with easier to read structure. Longer files will be
stored in this format. Files located:
<a href="https://github.com/trinker/qdapRegex/tree/master/inst/regex_scripts">https://github.com/trinker/qdapRegex/tree/master/inst/regex_scripts</a></p></li>
<li>
<p>rm_caps_phrase has a new regular expression that is more accurate and does
not pull trailing white space.</p>
<a class="anchor" href="#qdapregex-013---020"><span class="octicon octicon-link"></span></a><a href="https://github.com/trinker/qdapRegex">qdapRegex</a> 0.1.3 - 0.2.0
</li>
</ul>
<p><strong>BUG FIXES</strong></p>
<ul>
<li><p>pastex would throw a warning on a vector (e.g., pastex(letters)). This
has been fixed.</p></li>
<li><p>youtube_id was documented under qdap_usa rather than qdap_supplement and
contained an invalid hyperlink. This has been fixed.</p></li>
<li><p>rm_citation contained a bug that would not operate on citations with a comma
in multiple authors before the and/& sign. See <a href="https://github.com/trinker/qdapRegex/issues/4">issue #4</a></p></li>
</ul>
<p><strong>NEW FEATURES</strong></p>
<ul>
<li><p>is.regex added as a logical check of a regular expression's validy (conforms
to R's regular expression rules).</p></li>
<li><p>rm_postal_code added for removing/extracting/replacing U.S. postal codes.</p></li>
<li><p>Case wrapper functions, TC (title case), U (upper case), and L (lower
case) added for convenient case manipulation.</p></li>
<li><p>group function added to allow for convenient wrapping of grouping
parenthesis around regular expressions.</p></li>
<li><p>rm_citation_tex added to remove/extract/replace bibkey citations from a .tex
(LaTeX) file.</p></li>
<li><p>regex_cheat data set and cheat function added to act as a quick reference
for common regex task operations such a lookaheads.</p></li>
<li><p>rm_caps_phrase added to supplement rm_caps, extending the search to phases.</p></li>
<li><p>explain added to view a visual representation of a regular expression using
<a href="http://www.regexper.com"></a><a href="http://www.regexper.com">http://www.regexper.com</a> and <a href="http://rick.measham.id.au/paste/explain."></a><a href="http://rick.measham.id.au/paste/explain">http://rick.measham.id.au/paste/explain</a>. Also
takes named regular expressions from the regex_usa or other supplied
dictionary.</p></li>
</ul>
<p><strong>MINOR FEATURES</strong></p>
<ul>
<li><p>last_occurrence regex added to the regex_supplement dictionary to find the
last occurrence of delimiter.</p></li>
<li><p>word_boundary, word_boundary_left, and word_boundary_right added to
regex_supplement dictionary to provide a true word boundary. Regexes
adapted from: <a href="http://www.rexegg.com/regex-boundaries.html#real-word-boundary"></a><a href="http://www.rexegg.com/regex-boundaries.html#real-word-boundary">http://www.rexegg.com/regex-boundaries.html#real-word-boundary</a></p></li>
<li><p>rm_time2 regex added to the regex_usa dictionary to find time + AM/PM</p></li>
</ul>
<p><strong>IMPROVEMENTS</strong></p>
<ul>
<li><p>The regex_usa dictionary regular expressions: rm_hash, rm_tag, rm_tag2
and rm_between pick up grouping that allows for replacement of individual
sections of the substring. See ?rm_hash and ?rm_tag for examples.</p></li>
<li><p>pastex picks up a sep argument to allow the user to choose what string
is used to separate the collapsed expressions.</p></li>
<li>
<p>rm_citation, rm_citation2, and rm_citation3 now attempt to include last
names that contain the lower case particles: von, van, de, da, and du.</p>
<a class="anchor" href="#qdapregex-012"><span class="octicon octicon-link"></span></a><a href="https://github.com/trinker/qdapRegex">qdapRegex</a> 0.1.2
</li>
</ul>
<p>CRAN fix for oldrel Windows. Updated to R version 3.1.0 in Description file.</p>
<p><strong>NEW FEATURES</strong></p>
<ul>
<li>
<p>bind added as a convenience function to add a left and right boundary to
each element of a character vector.</p>
<a class="anchor" href="#qdapregex-011"><span class="octicon octicon-link"></span></a><a href="https://github.com/trinker/qdapRegex">qdapRegex</a> 0.1.1
</li>
</ul>
<p>First CRAN Release</p>
<p><strong>NEW FEATURES</strong></p>
<ul>
<li><p>rm_citation added for removing/extracting/replacing APA 6 style in-text
citations.</p></li>
<li><p>rm_white and accompanying family of rm_white functions added to remove
white space.</p></li>
<li><p>rm_non_ascii added to remove non-ASCII characters from a string.</p></li>
<li><p>around_ added to extract word(s) around a given point.</p></li>
<li><p>pages and pages2 added to the regex_supplement data set for
removing/extracting/validating page numbers.</p></li>
</ul>
<p><strong>IMPROVEMENTS</strong></p>
<ul>
<li>
<p>rm_XXX family of functions now use stringi::stri_extract_all_regex as this
approach is much faster than the
regmatches(text.var, gregexpr(pattern, text.var, perl = TRUE)) approach.</p>
<a class="anchor" href="#qdapregex-001---020"><span class="octicon octicon-link"></span></a><a href="https://github.com/trinker/qdapRegex">qdapRegex</a> 0.0.1 - 0.2.0
</li>
</ul>
<p>This package is a collection of regex tools associated with the qdap
package that may be useful outside of the context of discourse analysis. Tools
include removal/extraction/replacement of abbreviations, dates, dollar amounts,
email addresses, hash tags, numbers, percentages, person tags, phone numbers,
times, and zip codes.</p>
qdapRegex: Regular expression removal/extraction/replacement tools
<a name="user-content-qdapregex-010" class="anchor" href="#qdapregex-010"></a>qdapRegex 0.1.0
<p><strong>BUG FIXES</strong></p>
<p><strong>NEW FEATURES</strong></p>
<p><strong>MINOR FEATURES</strong></p>
<p><strong>IMPROVEMENTS</strong></p>
<p><strong>CHANGES</strong></p>
<a name="user-content-qdapregex-001" class="anchor" href="#qdapregex-001"></a>qdapRegex 0.0.1
<p>This package is a collection of regex tools associated with the qdap
package that may be useful outside of the context of discourse analysis. Tools
include removal/extraction/replacement of abbreviations, dates, dollar amounts,
email addresses, hash tags, numbers, percentages, person tags, phone numbers,
times, and zip codes.</p>
discon: discon: version 0.1.0
<a class="anchor" href="#news-"><span class="octicon octicon-link"></span></a>NEWS
<a class="anchor" href="#versioning"><span class="octicon octicon-link"></span></a>Versioning
<p>Releases will be numbered with the following semantic versioning format:</p>
<p><major>.<minor>.<patch></p>
<p>And constructed with the following guidelines:</p>
<ul>
<li>Breaking backward compatibility bumps the major (and resets the minor
and patch)</li>
<li>New additions without breaking backward compatibility bumps the minor
(and resets the patch)</li>
<li>
<p>Bug fixes and misc changes bumps the patch</p>
<a class="anchor" href="#discon-010--"><span class="octicon octicon-link"></span></a>
<a href="https://github.com/trinker/discon">discon</a> 0.1.0
</li>
</ul>
<p><strong>BUG FIXES</strong></p>
<p><strong>NEW FEATURES</strong></p>
<p><strong>MINOR FEATURES</strong></p>
<p><strong>IMPROVEMENTS</strong></p>
<p><strong>CHANGES</strong></p>
<ul>
<li>
<p>The <strong>discmark</strong> package was renamed to <a href="https://github.com/trinker/discon">discon</a>. The latter is a more
inclusive term that better defines the scope of the package.</p>
<a class="anchor" href="#discon-003---"><span class="octicon octicon-link"></span></a>
<a href="https://github.com/trinker/discon">discon</a> 0.0.3
</li>
</ul>
<p><strong>BUG FIXES</strong></p>
<ul>
<li>
discourse_marker did not retain the correct grouping variable(s) name in the
termco output as well as the ggplot::ylab on the dispersion_plot. See
<a href="https://github.com/trinker/discon/issues/3">issue #3</a> for more.</li>
</ul>
<p><strong>NEW FEATURES</strong></p>
<ul>
<li><p>dm_context & dm_context_sub functions added to search for context discourse
markers.</p></li>
<li><p>dm_equality & dm_equality_sub functions added to search for equality
discourse markers.</p></li>
</ul>
<p><strong>IMPROVEMENTS</strong></p>
<ul>
<li>
additional unit test forprint.discourse_marker` added.</li>
</ul>
<p><strong>CHANGES</strong></p>
<ul>
<li>
<p><strong>ggplot2</strong> added to the DESCRIPTION file's Imports: for correction of the
plot's ylab in the plot method for discourse_marker.</p>
<a class="anchor" href="#discon-002---"><span class="octicon octicon-link"></span></a>
<a href="https://github.com/trinker/discon">discon</a> 0.0.2
</li>
</ul>
<p><strong>NEW FEATURES</strong></p>
<ul>
<li><p>discourse_marker template added to make the package more modular and
consistent. discoure_marker also becomes a generic class transfered to all
dm_ prefixed discourse marker functions. The accompanying plot method
allows for a lexical dispersion plot, a visual methd of seeing distribution of
terms across time.</p></li>
<li><p>dm_causality & dm_causality_sub functions added to search for causal discourse
markers.</p></li>
<li><p>dm_revision function added to search for revision discourse markers.</p></li>
</ul>
<p><strong>IMPROVEMENTS</strong></p>
<ul>
<li><p>hijack function used with discourse_marker template to make the package
more modular.</p></li>
<li><p>discourse_marker is expanded to generalize to n lists of regular expressions
(regex) rather than 1-2. The regex.markup argument has been removed and
regex supplies this information.</p></li>
<li><p>Examples added to the <strong>README.md</strong> fie.</p></li>
</ul>
<p><strong>CHANGES</strong></p>
<ul>
<li>
<p>taxonomy renamed to dm_typology.</p>
<a class="anchor" href="#discon-001-"><span class="octicon octicon-link"></span></a>
<a href="https://github.com/trinker/discon">discon</a> 0.0.1
</li>
</ul>
<p>Initial upload of <strong>dismark</strong>:</p>
<p><a href="https://github.com/trinker/discon">discon</a> is a collection of tools for analysing discourse markers in text. </p>
pax: Version 0.0.1
<a class="anchor" href="#news"><span class="octicon octicon-link"></span></a>NEWS
<a class="anchor" href="#versioning"><span class="octicon octicon-link"></span></a>Versioning
<p>Releases will be numbered with the following semantic versioning format:</p>
<p><major>.<minor>.<patch></p>
<p>And constructed with the following guidelines:</p>
<ul>
<li><p>Breaking backward compatibility bumps the major (and resets the minor
and patch)</p></li>
<li><p>New additions without breaking backward compatibility bumps the minor
(and resets the patch)</p></li>
<li><p>Bug fixes and misc changes bumps the patch</p></li>
</ul>
<a class="anchor" href="#bchangesb-in-pax-version-001"><span class="octicon octicon-link"></span></a><b>CHANGES</b> IN <a href="https://github.com/trinker/pax">pax</a> VERSION 0.0.1
<ul>
<li><p>The first CRAN installation of the <a href="https://github.com/trinker/pax">pax</a> package</p></li>
<li><p>Package designed to provide a package templating system that assumes the use
of testthat, Travis-CI and covr (coveralls).</p></li>
</ul>
qdapDictionaries Version 1.0.2
<a name="user-content-qdapdictionaries-102" class="anchor" href="#qdapdictionaries-102"></a>qdapDictionaries 1.0.2
<p><strong>BUG FIXES</strong></p>
<ul>
<li>
key.syn contained antonyms and elemets the were error messages (character).
This has been fixed. Reference <a href="https://github.com/trinker/qdapDictionaries/issues/2">issue #2</a>. (Jingjing Zou)</li>
</ul><p><strong>NEW FEATURES</strong></p>
<ul>
<li>
GradyAugmented was added. This augmented Grady data set is a large list of
known English words and proper nouns.</li>
</ul><p><strong>IMPROVEMENTS</strong></p>
<ul>
<li>
contractions data set picks up 3 words: "it'll", "'cause", & "there'll".</li>
</ul>
trinker/qdapRegex: version 0.7.2
NEWS
Versioning
<p>Releases will be numbered with the following semantic versioning format:</p>
<p><major>.<minor>.<patch></p>
<p>And constructed with the following guidelines:</p>
<ul>
<li>Breaking backward compatibility bumps the major (and resets the minor
and patch)</li>
<li>New additions without breaking backward compatibility bumps the minor
(and resets the patch)</li>
<li>Bug fixes and misc changes bumps the patch</li>
</ul>
<a href="https://github.com/trinker/qdapRegex" target="_blank">qdapRegex</a> 0.7.0 - 0.7.2
<p><strong>BUG FIXES</strong></p>
<ul>
<li><code>rm_dollar</code>'s regex now allows for commas in the dollar portion.</li>
</ul>
<p><strong>NEW FEATURES</strong></p>
<ul>
<li><code>as_count</code> added to convert <code>ex_citation</code> into counts of citations.</li>
</ul>
<p><strong>MINOR FEATURES</strong></p>
<ul>
<li><code>ex_</code> added to compliment the <code>rm_</code> function.</li>
</ul>
<p><strong>IMPROVEMENTS</strong></p>
<ul>
<li><code>grab</code> and functions that use <code>@rm_xxx</code> now work on <code>ex_xxx</code> as well.</li>
</ul>
<p><strong>CHANGES</strong></p>
<ul>
<li><code>explain</code> is fully functional again as <a href="http://rick.measham.id.au/paste/explain" target="_blank">http://rick.measham.id.au/paste/explain</a>
is again functioning.</li>
</ul>
<a href="https://github.com/trinker/qdapRegex" target="_blank">qdapRegex</a> 0.6.0
<p><strong>NEW FEATURES</strong></p>
<ul>
<li><code>rm_</code> prefixed functions get an extraction counterpart prefixed with <code>ex_</code>.<br>
This means users can use <code>ex_</code> functions directly without using the <code>rm_</code> form
in the less convenient form of <code>rm_xxx(extract = TRUE)</code>.</li>
</ul>
<a href="https://github.com/trinker/qdapRegex" target="_blank">qdapRegex</a> 0.5.1
<p><strong>BUG FIXES</strong></p>
<ul>
<li><code>rm_number</code> incorrectly did not handle multiple comma separated digits (see
<a href="https://github.com/trinker/qdapRegex/issues/17">issue #17</a>). This behavior has been fixed and a unit test added to ensure
proper handling.</li>
</ul>
<a href="https://github.com/trinker/qdapRegex" target="_blank">qdapRegex</a> 0.4.1-0.5.0
<p><strong>BUG FIXES</strong></p>
<ul>
<li><code>rm_between</code> did not handle single quotation marks (<code>'</code>) as both the left and
right boundary when <code>extract = TRUE</code>. Related to <a href="https://github.com/trinker/qdapRegex/issues/13">issue #13</a></li>
</ul>
<p><strong>NEW FEATURES</strong></p>
<ul>
<li><p><code>rm_transcript_time</code> added to remove transcript specific style of time stamp
tagging. See <a href="http://help-nv10mac.qsrinternational.com/desktop/procedures/import_audio_or_video_transcripts.htm" target="_blank">http://help-nv10mac.qsrinternational.com/desktop/procedures/import_audio_or_video_transcripts.htm</a> for details.</p>
</li>
<li><p><code>as_time</code> and <code>as_time2</code> added for use with <code>rm_time</code>/<code>rm_time_trnscript</code>.<br>
These are convert to the standard HH:MM:SS.OS format and optionally converts
to <code>as.POSIXlt</code>. The former outputs a list of vectors of times while the
later wraps <code>as_time</code> with <code>unlist</code>.</p>
</li>
</ul>
<p><strong>MINOR FEATURES</strong></p>
<ul>
<li><p><code>except_first</code> added to <code>regex_supplement</code> dictionary to provide a means to
remove all occurrences of a character except the first appearance. Regex
from: <a href="http://stackoverflow.com/a/31458261/1000343" target="_blank">http://stackoverflow.com/a/31458261/1000343</a></p>
</li>
<li><p><code>rm_between</code> and <code>r_between_multiple</code> pick up a <code>fixed</code> argument. Previously,
<code>left</code> and <code>right</code> boundaries containing regular expression special characters
were fixed by default (escaped). This did not allow for the powerful use of a
regular expression for left/right boundaries. The <code>fixed = TRUE</code> behavior
is still the default but users can now set <code>fixed = FALSE</code> to work with
regular expression boundaries. This new feature was inspired by @Ronak Shah's
StackOverflow question: <a href="http://stackoverflow.com/q/31623069/1000343" target="_blank">http://stackoverflow.com/q/31623069/1000343</a></p>
</li>
</ul>
<p><strong>CHANGES</strong></p>
<ul>
<li><p><code>word_boundary</code>, <code>word_boundary_left</code>, <code>word_boundary_right</code> regexes in the
<code>regex_supplement</code> did not include apostrophes as a viable word character.
Apostrophes are now included as a word character.</p>
</li>
<li><p><code>explain</code> no longer prints the regular expression explanation to the command
line. Instead the link to <a href="http://www.regexper.com" target="_blank">http://www.regexper.com</a> is printed. This change
is because <a href="http://rick.measham.id.au/paste/explain" target="_blank">http://rick.measham.id.au/paste/explain</a> no longer appears to be
working. The text explanation functionality will return if the website
becomes operational again or if a suitable substitute can be found.</p>
<p><a href="https://github.com/trinker/qdapRegex" target="_blank">qdapRegex</a> 0.4.0</p>
</li>
</ul>
<p><strong>BUG FIXES</strong></p>
<ul>
<li><p><code>rm_number</code> did not extract consecutive digits that aren't comma separated
without separating it into multiple strings. For example "12345" became
"123" "45". Also 444,44 will not be removed/extracted as it is not a valid
comma separated number. These behavior have been corrected and the unit test
now include these cases. Thanks to Jason Gray for the rework of the regex.
It is simpler and more accurate.</p>
</li>
<li><p><code>rm_between</code> did not handle quotation marks (<code>"</code>) as both the left and right
boundary when <code>extract = TRUE</code>. Bug reported by Tori Shannon,
<a href="http://stackoverflow.com/q/31119989/1000343," target="_blank">http://stackoverflow.com/q/31119989/1000343,</a> and addressed by Jason Gray. See
<a href="https://github.com/trinker/qdapRegex/issues/13">issue #13</a></p>
</li>
</ul>
<p><strong>NEW FEATURES</strong></p>
<ul>
<li><p><code>as_numeric</code> & <code>as_numeric2</code> added for use with <code>rm_number</code>. These are
wrappers for <code>as.numeric(gsub(",", "", x))</code>. The former removes commas and
converts a list of vectors of strings to numeric. The later wraps
<code>as_numeric</code> with <code>unlist</code>.</p>
</li>
<li><p><code>rm_non_words</code> added to remove every any character that isn't a letter,
apostrophe, or single space.</p>
</li>
<li><p>The class <code>extracted</code> has been added and is the output of a <code>rm_xxx</code> function
when <code>extract = TRUE</code>. This allows for the <code>c.extracted</code> function to easily
turn the <code>list</code> output into a character vector.</p>
</li>
<li><p><code>c.extracted</code> added to provide a quick unlist method for <code>list</code>s of class
<code>extracted</code>. The is less typing than <code>unlist</code> for an approach that is used
often.</p>
</li>
<li><p><code>bind_or</code> added as a means of quickly wrapping multiple sub-expression
elements with left/right boundaries and then concatenate/joins the grouped
strings with regular expression or statement ("|").</p>
</li>
</ul>
<p><strong>MINOR FEATURES</strong></p>
<ul>
<li><code>punctuation</code> added to <code>regex_supplement</code> dictionary for easy negation of
<code>[:punct:]</code> class.</li>
</ul>
<a href="https://github.com/trinker/qdapRegex" target="_blank">qdapRegex</a> 0.2.1 - 0.3.2
<p><strong>BUG FIXES</strong></p>
<ul>
<li><p><code>explain</code> used <code>message</code> to print to the console. <code>explain</code> now returns an
object of the class <code>explain</code> with its own print method which uses <code>cat</code>
rather than <code>message</code>. Additionally, the characters <code>+</code> and <code>&</code> were not
handled correctly; this has been corrected.</p>
</li>
<li><p>Documentation for <code>TC</code> "there is an incomplete sentence. It is as follows:
TC utilizes additional rules for capitalization beyond <code>stri_trans_totitle</code>
that includes..." (found by rmsharp). This has been corrected. See <a href="https://github.com/trinker/qdapRegex/issues/8">issue #8</a></p>
</li>
<li><p><code>cheat</code> (and accompanying <code>regex_cheat</code> dictionary) contained misspellings in
the words <em>greedy</em> and <em>beginning</em>. This has been corrected.</p>
</li>
<li><p><code>rm_number</code> incorrectly handled numbers containing leading or trailing zeros.
See <a href="https://github.com/trinker/qdapRegex/issues/9">issue #9</a></p>
</li>
<li><p><code>rm_caps_phrases</code> could only extract/remove up to two "words" worth of capital
letter phrases at a time. See <a href="https://github.com/trinker/qdapRegex/issues/11">issue #11</a></p>
</li>
</ul>
<p><strong>NEW FEATURES</strong></p>
<ul>
<li><p><code>%+%</code> binary operator version of <code>pastex(x, y, sep = "")</code> added to join
regular expressions together.</p>
</li>
<li><p><code>group_or</code> added as a means of quickly wrapping multiple sub-expression
elements with grouping parenthesis and then concatenate/joins the grouped
strings with regular expression or statement ("|").</p>
</li>
<li><p><code>rm_repeated_characters</code> added for removing/extracting/replacing words with
repeated characters (each repeated > 2 times). Regex pattern comes from:
StackOverflow's vks (<a href="http://stackoverflow.com/a/29438461/1000343)." target="_blank">http://stackoverflow.com/a/29438461/1000343).</a></p>
</li>
<li><p><code>rm_repeated_phrases</code> added for removing/extracting/replacing repeating
phrases (> 2 times). Regex pattern comes from:
StackOverflow's BrodieG (<a href="http://stackoverflow.com/a/28786617/1000343)." target="_blank">http://stackoverflow.com/a/28786617/1000343).</a></p>
</li>
<li><p><code>rm_repeated_words</code> added for removing/extracting/replacing repeating words
(> 2 times).</p>
</li>
</ul>
<p><strong>MINOR FEATURES</strong></p>
<ul>
<li><code>run_split</code> regex added to the <code>regex_supplement</code> dictionary to split runs
into chunks.</li>
</ul>
<p><strong>IMPROVEMENTS</strong></p>
<ul>
<li><p>Regular Expression Dictionaries (e.g., <code>regex_usa</code> and <code>regex_supplement</code>) are
now managed with the <strong>regexr</strong> package. This enables cleaner updating of the
regular expressions with easier to read structure. Longer files will be
stored in this format. Files located:
<a href="https://github.com/trinker/qdapRegex/tree/master/inst/regex_scripts">https://github.com/trinker/qdapRegex/tree/master/inst/regex_scripts</a></p>
</li>
<li><p><code>rm_caps_phrase</code> has a new regular expression that is more accurate and does
not pull trailing white space.</p>
</li>
</ul>
<a href="https://github.com/trinker/qdapRegex" target="_blank">qdapRegex</a> 0.1.3 - 0.2.0
<p><strong>BUG FIXES</strong></p>
<ul>
<li><p><code>pastex</code> would throw a warning on a vector (e.g., <code>pastex(letters)</code>). This
has been fixed.</p>
</li>
<li><p><code>youtube_id</code> was documented under <code>qdap_usa</code> rather than <code>qdap_supplement</code> and
contained an invalid hyperlink. This has been fixed.</p>
</li>
<li><p><code>rm_citation</code> contained a bug that would not operate on citations with a comma
in multiple authors before the and/& sign. See <a href="https://github.com/trinker/qdapRegex/issues/4">issue #4</a></p>
</li>
</ul>
<p><strong>NEW FEATURES</strong></p>
<ul>
<li><p><code>is.regex</code> added as a logical check of a regular expression's validy (conforms
to R's regular expression rules).</p>
</li>
<li><p><code>rm_postal_code</code> added for removing/extracting/replacing U.S. postal codes.</p>
</li>
<li><p>Case wrapper functions, <code>TC</code> (title case), <code>U</code> (upper case), and <code>L</code> (lower
case) added for convenient case manipulation.</p>
</li>
<li><p><code>group</code> function added to allow for convenient wrapping of grouping
parenthesis around regular expressions.</p>
</li>
<li><p><code>rm_citation_tex</code> added to remove/extract/replace bibkey citations from a .tex
(LaTeX) file.</p>
</li>
<li><p><code>regex_cheat</code> data set and <code>cheat</code> function added to act as a quick reference
for common regex task operations such a lookaheads.</p>
</li>
<li><p><code>rm_caps_phrase</code> added to supplement <code>rm_caps</code>, extending the search to phases.</p>
</li>
<li><p><code>explain</code> added to view a visual representation of a regular expression using
<a href="http://www.regexper.com" target="_blank">http://www.regexper.com</a> and <a href="http://rick.measham.id.au/paste/explain." target="_blank">http://rick.measham.id.au/paste/explain.</a> Also
takes named regular expressions from the <code>regex_usa</code> or other supplied
dictionary.</p>
</li>
</ul>
<p><strong>MINOR FEATURES</strong></p>
<ul>
<li><p><code>last_occurrence</code> regex added to the <code>regex_supplement</code> dictionary to find the
last occurrence of delimiter.</p>
</li>
<li><p><code>word_boundary</code>, <code>word_boundary_left</code>, and <code>word_boundary_right</code> added to
<code>regex_supplement</code> dictionary to provide a true word boundary. Regexes
adapted from: <a href="http://www.rexegg.com/regex-boundaries.html#real-word-boundary" target="_blank">http://www.rexegg.com/regex-boundaries.html#real-word-boundary</a></p>
</li>
<li><p><code>rm_time2</code> regex added to the <code>regex_usa</code> dictionary to find time + AM/PM</p>
</li>
</ul>
<p><strong>IMPROVEMENTS</strong></p>
<ul>
<li><p>The <code>regex_usa</code> dictionary regular expressions: <code>rm_hash</code>, <code>rm_tag</code>, <code>rm_tag2</code>
and <code>rm_between</code> pick up grouping that allows for replacement of individual
sections of the substring. See <code>?rm_hash</code> and <code>?rm_tag</code> for examples.</p>
</li>
<li><p><code>pastex</code> picks up a <code>sep</code> argument to allow the user to choose what string
is used to separate the collapsed expressions.</p>
</li>
<li><p><code>rm_citation</code>, <code>rm_citation2</code>, and <code>rm_citation3</code> now attempt to include last
names that contain the lower case particles: von, van, de, da, and du.</p>
</li>
</ul>
<a href="https://github.com/trinker/qdapRegex" target="_blank">qdapRegex</a> 0.1.2
<p>CRAN fix for oldrel Windows. Updated to R version 3.1.0 in Description file.</p>
<p><strong>NEW FEATURES</strong></p>
<ul>
<li><code>bind</code> added as a convenience function to add a left and right boundary to
each element of a character vector.</li>
</ul>
<a href="https://github.com/trinker/qdapRegex" target="_blank">qdapRegex</a> 0.1.1
<p>First CRAN Release</p>
<p><strong>NEW FEATURES</strong></p>
<ul>
<li><p><code>rm_citation</code> added for removing/extracting/replacing APA 6 style in-text
citations.</p>
</li>
<li><p><code>rm_white</code> and accompanying family of <code>rm_white</code> functions added to remove
white space.</p>
</li>
<li><p><code>rm_non_ascii</code> added to remove non-ASCII characters from a string.</p>
</li>
<li><p><code>around_</code> added to extract word(s) around a given point.</p>
</li>
<li><p><code>pages</code> and <code>pages2</code> added to the <code>regex_supplement</code> data set for
removing/extracting/validating page numbers.</p>
</li>
</ul>
<p><strong>IMPROVEMENTS</strong></p>
<ul>
<li><code>rm_XXX</code> family of functions now use <code>stringi::stri_extract_all_regex</code> as this
approach is much faster than the
<code>regmatches(text.var, gregexpr(pattern, text.var, perl = TRUE))</code> approach.</li>
</ul>
<a href="https://github.com/trinker/qdapRegex" target="_blank">qdapRegex</a> 0.0.1 - 0.2.0
<p>This package is a collection of regex tools associated with the qdap
package that may be useful outside of the context of discourse analysis. Tools
include removal/extraction/replacement of abbreviations, dates, dollar amounts,
email addresses, hash tags, numbers, percentages, person tags, phone numbers,
times, and zip codes.</p>
- …
