Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking &...

19
8/3/15 7:42 PM Ranking & UB-CF Page 1 of 19 file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1 Ranking & UB-CF Ranking & UB-CF IIC 3633 - Sistemas Recomendadores Denis Parra Profesor Asistente, DCC, PUC CHile

Transcript of Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking &...

Page 1: Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking & UB-CF 8/3/15 7:42 PM file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

8/3/15 7:42 PMRanking & UB-CF

Page 1 of 19file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

Ranking & UB-CFRanking & UB-CFIIC 3633 - Sistemas Recomendadores

Denis ParraProfesor Asistente, DCC, PUC CHile

Page 2: Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking & UB-CF 8/3/15 7:42 PM file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

8/3/15 7:42 PMRanking & UB-CF

Page 2 of 19file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

TOCEn esta clase

1. Definición y un poco de Historia

2. Ranking No Personalizado

3. User-Based Collaborative Filtering

4. Referencias

2/19

Page 3: Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking & UB-CF 8/3/15 7:42 PM file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

8/3/15 7:42 PMRanking & UB-CF

Page 3 of 19file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

DefiniciónRecommender Systems aim to help a user or a group of users in a system to select items from a crowded item or information space. (MacNee et. al 2006)

R. Burke tenía su propia definición, similar a esta, pero agregaba ...in a personalized way.

El problema de recomendación formalizado (Adomavicius et al. 2007)

∀c ∈ C, = arg u(c, s)s′c maxs∈S

u : C × S → R, funcion de utilidad

R : conjunto recomendado de itemsC : conjunto de usuarios

S : conjunto de items

3/19

Page 4: Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking & UB-CF 8/3/15 7:42 PM file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

8/3/15 7:42 PMRanking & UB-CF

Page 4 of 19file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

1. Un Poco de Historia

4/19

Page 5: Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking & UB-CF 8/3/15 7:42 PM file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

8/3/15 7:42 PMRanking & UB-CF

Page 5 of 19file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

1.1 En 1992 Xerox PARC Tapestry

Link to PDF file

5/19

Page 6: Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking & UB-CF 8/3/15 7:42 PM file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

8/3/15 7:42 PMRanking & UB-CF

Page 6 of 19file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

1.2 MovieLens

6/19

Page 7: Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking & UB-CF 8/3/15 7:42 PM file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

8/3/15 7:42 PMRanking & UB-CF

Page 7 of 19file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

NetFlix Prize (2007-2009)

7/19

Page 8: Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking & UB-CF 8/3/15 7:42 PM file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

8/3/15 7:42 PMRanking & UB-CF

Page 8 of 19file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

1.3 Netflix en 2012

Link to Amatriain 2012

8/19

Page 9: Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking & UB-CF 8/3/15 7:42 PM file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

8/3/15 7:42 PMRanking & UB-CF

Page 9 of 19file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

1.3 Netflix en 2012 (continuación)

9/19

Page 10: Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking & UB-CF 8/3/15 7:42 PM file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

8/3/15 7:42 PMRanking & UB-CF

Page 10 of 19file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

Ranking no personalizado (Blog de Evan Miller,2009)1. Popularidad.

2. Score: (Ratings Positivos) - (Ratings Negativos)

3. Score: (Rating Promedio) = (Ratings Positivos)/(Total de Ratings)

4. Score: Considerando Ratings positivos y negativos, Limite inferior del Intervalo de Confianza del Wilson Score,para un parámetro Bernoulli.

Donde es la proporción (estimada) de ratings positivos, es el cuantil de la distribución normal, y el número deratings. , también llamado nivel de significancia estadístico, generalmente se considera 95%.

p̂ zα/2 (1 − α/2) nα

10/19

Page 11: Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking & UB-CF 8/3/15 7:42 PM file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

8/3/15 7:42 PMRanking & UB-CF

Page 11 of 19file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

Clasificacion(es)1. Considerando los Datos usados

1. Basado en Reglas (Rule-based)

2. Basado en Contenido (Content-based)

3. Filtrado Colaborativo (el usuario y sus vecinos)

2. Considerando el Modelo

1. Memory-based (KNN)

2. Model-based (Representación latente)

11/19

Page 12: Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking & UB-CF 8/3/15 7:42 PM file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

8/3/15 7:42 PMRanking & UB-CF

Page 12 of 19file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

Filtrado Colaborativo basado en el usuarioDos tareas son necesarias:

KNN: Encontrar los K vecinos más cercanos (KNN) al usuario :

Predecir el rating que un usuario dará a un ítem :

· a

Similaridad(a, i) = w(a, i), i ∈ K

· a j

= + α w(a, i)( − )pa,j v̄a ∑i=1

nvi,j v̄i

12/19

Page 13: Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking & UB-CF 8/3/15 7:42 PM file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

8/3/15 7:42 PMRanking & UB-CF

Page 13 of 19file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

Ejemplo: Correlación de Pearson

13/19

Page 14: Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking & UB-CF 8/3/15 7:42 PM file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

8/3/15 7:42 PMRanking & UB-CF

Page 14 of 19file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

Ejemplo: Correlación de PearsonSOLUCION

14/19

Page 15: Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking & UB-CF 8/3/15 7:42 PM file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

8/3/15 7:42 PMRanking & UB-CF

Page 15 of 19file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

Ejemplo: Correlación de Pearson

15/19

Page 16: Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking & UB-CF 8/3/15 7:42 PM file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

8/3/15 7:42 PMRanking & UB-CF

Page 16 of 19file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

Ejemplo Paso 2: Predicción del rating

16/19

Page 17: Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking & UB-CF 8/3/15 7:42 PM file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

8/3/15 7:42 PMRanking & UB-CF

Page 17 of 19file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

Ejemplo Paso 2: Predicción del ratingSOLUCION

17/19

Page 18: Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking & UB-CF 8/3/15 7:42 PM file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

8/3/15 7:42 PMRanking & UB-CF

Page 18 of 19file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

Ejemplo Paso 2: Predicción del rating

18/19

Page 19: Ranking & UB-CFdparra.sitios.ing.uc.cl/classes/recsys-2015-2/clase1_recsysintro.pdf · Ranking & UB-CF 8/3/15 7:42 PM file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

8/3/15 7:42 PMRanking & UB-CF

Page 19 of 19file:///Users/denisparra/Dropbox/PUC/IIC3633-RecSys-2015_2do/Website_R/clase1_recsysintro.html#1

ReferenciasAdomavicius, G., & Tuzhilin, A. (2005). Toward the next generation of recommender systems: A survey of the state-of-the-art andpossible extensions. Knowledge and Data Engineering, IEEE Transactions on, 17(6), 734-749.

Amatriain, X. (2013). Mining large streams of user data for personalized recommendations. ACM SIGKDD Explorations Newsletter,14(2), 37-48.

Miller, B. N., Albert, I., Lam, S. K., Konstan, J. A., & Riedl, J. (2003, January). MovieLens unplugged: experiences with an occasionallyconnected recommender system. In Proceedings of the 8th international conference on Intelligent user interfaces (pp. 263-266). ACM.

Parra, D., & Sahebi, S. (2013). Recommender systems: Sources of knowledge and evaluation metrics. In Advanced Techniques in WebIntelligence-2 (pp. 149-175). Springer Berlin Heidelberg.

·

·

·

·

19/19