* installing *source* package 'tokenizers' ...
** package 'tokenizers' successfully unpacked and MD5 sums checked
** using staged installation
** libs
using C++ compiler: 'g++.exe (GCC) 12.3.0'
make[1]: Entering directory '/d/temp/RtmpctDLjj/R.INSTALL5f982c367f63/tokenizers/src'
g++ -std=gnu++17  -I"D:/RCompile/recent/R-4.3.3/include" -DNDEBUG  -I'D:/RCompile/CRANpkg/lib/4.3/Rcpp/include'   -I"d:/rtools43/x86_64-w64-mingw32.static.posix/include"     -pedantic -O2 -Wall  -mfpmath=sse -msse2 -mstackrealign  -c RcppExports.cpp -o RcppExports.o
g++ -std=gnu++17  -I"D:/RCompile/recent/R-4.3.3/include" -DNDEBUG  -I'D:/RCompile/CRANpkg/lib/4.3/Rcpp/include'   -I"d:/rtools43/x86_64-w64-mingw32.static.posix/include"     -pedantic -O2 -Wall  -mfpmath=sse -msse2 -mstackrealign  -c shingle_ngrams.cpp -o shingle_ngrams.o
shingle_ngrams.cpp: In function 'size_t get_ngram_seq_len(int, int, int)':
shingle_ngrams.cpp:8:36: warning: comparison of integer expressions of different signedness: 'size_t' {aka 'long long unsigned int'} and 'int' [-Wsign-compare]
    8 |   for (size_t i = ngram_min - 1; i < ngram_max; i++)
      |                                  ~~^~~~~~~~~~~
shingle_ngrams.cpp: In function 'Rcpp::CharacterVector generate_ngrams_internal(Rcpp::CharacterVector, int, int, std::set<std::__cxx11::basic_string<char> >&, std::deque<std::__cxx11::basic_string<char> >&, std::string)':
shingle_ngrams.cpp:28:24: warning: comparison of integer expressions of different signedness: 'size_t' {aka 'long long unsigned int'} and 'R_xlen_t' {aka 'long long int'} [-Wsign-compare]
   28 |   for (size_t i = 0; i < terms_raw.size(); i++) {
      |                      ~~^~~~~~~~~~~~~~~~~~
shingle_ngrams.cpp:45:23: warning: comparison of integer expressions of different signedness: 'size_t' {aka 'long long unsigned int'} and 'int' [-Wsign-compare]
   45 |   for(size_t j = 0; j < len; j++ ) {
      |                     ~~^~~~~
shingle_ngrams.cpp:48:14: warning: comparison of integer expressions of different signedness: 'size_t' {aka 'long long unsigned int'} and 'const int' [-Wsign-compare]
   48 |     while (k <= ngram_max && j_max_observed < len) {
      |            ~~^~~~~~~~~~~~
shingle_ngrams.cpp:48:45: warning: comparison of integer expressions of different signedness: 'size_t' {aka 'long long unsigned int'} and 'int' [-Wsign-compare]
   48 |     while (k <= ngram_max && j_max_observed < len) {
      |                              ~~~~~~~~~~~~~~~^~~~~
shingle_ngrams.cpp:56:12: warning: comparison of integer expressions of different signedness: 'size_t' {aka 'long long unsigned int'} and 'const int' [-Wsign-compare]
   56 |       if(k >= ngram_min) {
      |          ~~^~~~~~~~~~~~
shingle_ngrams.cpp: In function 'Rcpp::ListOf<Rcpp::Vector<16> > generate_ngrams_batch(Rcpp::ListOf<const Rcpp::Vector<16> >, int, int, Rcpp::CharacterVector, Rcpp::String)':
shingle_ngrams.cpp:84:23: warning: comparison of integer expressions of different signedness: 'size_t' {aka 'long long unsigned int'} and 'R_xlen_t' {aka 'long long int'} [-Wsign-compare]
   84 |   for(size_t i = 0; i < stopwords.size(); i++){
      |                     ~~^~~~~~~~~~~~~~~~~~
g++ -std=gnu++17  -I"D:/RCompile/recent/R-4.3.3/include" -DNDEBUG  -I'D:/RCompile/CRANpkg/lib/4.3/Rcpp/include'   -I"d:/rtools43/x86_64-w64-mingw32.static.posix/include"     -pedantic -O2 -Wall  -mfpmath=sse -msse2 -mstackrealign  -c skip_ngrams.cpp -o skip_ngrams.o
g++ -std=gnu++17 -shared -s -static-libgcc -o tokenizers.dll tmp.def RcppExports.o shingle_ngrams.o skip_ngrams.o -Ld:/rtools43/x86_64-w64-mingw32.static.posix/lib/x64 -Ld:/rtools43/x86_64-w64-mingw32.static.posix/lib -LD:/RCompile/recent/R-4.3.3/bin/x64 -lR
make[1]: Leaving directory '/d/temp/RtmpctDLjj/R.INSTALL5f982c367f63/tokenizers/src'
make[1]: Entering directory '/d/temp/RtmpctDLjj/R.INSTALL5f982c367f63/tokenizers/src'
make[1]: Leaving directory '/d/temp/RtmpctDLjj/R.INSTALL5f982c367f63/tokenizers/src'
installing to d:/Rcompile/CRANpkg/lib/4.3/00LOCK-tokenizers/00new/tokenizers/libs/x64
** R
** data
*** moving datasets to lazyload DB
** inst
** byte-compile and prepare package for lazy loading
** help
*** installing help indices
** building package indices
** installing vignettes
** testing if installed package can be loaded from temporary location
** testing if installed package can be loaded from final location
** testing if installed package keeps a record of temporary installation path
* MD5 sums
packaged installation of 'tokenizers' as tokenizers_0.3.0.zip
* DONE (tokenizers)