r - RStudio fatal error while generating matrix -
i'm processing 2 char vectors outer function, results in matrix. i'm using levensthein function, compares 2 strings , outputs simialirity of them, each item vectors.
for tests 1000x1000 vectors, runs fine. runs in 4.95 sec.
calc_levensthein_d <- function(vector1,vector2){ #total matrix total <- as.matrix(outer(vector1,vector2,levenshteinsim)) return(total) }
however 10000x5000 vector, fatal error message, @ ending of processament.
here tests:
~1000x1000 -> 4~6 sec
~1000x5000 -> 40~60 sec
~10000x1000 -> 688 sec ~ 11min
~10000x5000 -> fatal error after 2hours
it's memory problem? ideias? goal process 120000x10000 matrix.
obs: levenshteinsim record linkage package.
Comments
Post a Comment