I Think I Know You, But Do I Really?