Human Generated Data

Title

Family Portrait (with Friend) at Artist's Home, Lloyd Harbor, New York
Date

August 1991
People

Artist: N. Jay Jaffee, American 1921 - 1999
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of the Artist, P1998.125
Copyright

© The N. Jay Jaffee Trust. All rights reserved. Used by permission. www.njayjaffee.com

Human Generated Data

Title

Family Portrait (with Friend) at Artist's Home, Lloyd Harbor, New York

People

Artist: N. Jay Jaffee, American 1921 - 1999

Date

August 1991

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the Artist, P1998.125

Copyright

© The N. Jay Jaffee Trust. All rights reserved. Used by permission. www.njayjaffee.com

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.7
Human 99.7
Person 99.6
Person 99.5
Person 99.1
Person 98.4
Person 97.7
Person 97.1
Person 96.7
Person 96.6
People 95.7
Person 95.5
Person 95.2
Person 94.9
Person 94.6
Shoe 94.1
Footwear 94.1
Clothing 94.1
Apparel 94.1
Person 91.6
Face 89.3
Person 87
Shoe 86.6
Person 84
Person 80.8
Crowd 80.8
Person 79.8
Person 78.3
Female 78.1
Person 76.3
Person 72.6
Person 72
Text 71.8
Family 71
Girl 70.3
Audience 64.2
Photography 62.2
Photo 62.2
Portrait 62
Smile 57.4
School 56.4
Kid 56.1
Child 56.1

Clarifai
created on 2023-10-25

people 99.9
group 99.7
group together 99.7
portrait 98.9
adult 97.5
man 97.5
son 95.8
child 95.5
wear 95.3
many 94.4
collage 92.3
woman 92.2
recreation 91.7
several 90.9
boy 90.9
facial expression 87.2
family 85.7
monochrome 85.1
school 82.1
actor 82

Imagga
created on 2021-12-14

man 34.3
people 31.8
group 29.8
male 28.3
person 27.2
happy 26.9
kin 26.7
smiling 25.3
child 23.9
team 23.3
room 22.8
classroom 22.4
portrait 22
together 21
family 20.4
adult 19.6
smile 19.2
business 18.8
men 18
businessman 17.6
mother 17.2
nurse 17
women 15.8
love 15.8
businesswoman 15.4
teacher 14.8
happiness 14.1
boy 13.9
cheerful 13.8
father 13.6
casual 13.5
kid 13.3
student 13.2
school 13.1
office 12.8
fun 12.7
daughter 12.6
lifestyle 12.3
meeting 12.2
professional 11.9
gymnasium 11.8
friends 11.3
success 11.3
education 11.2
teamwork 11.1
work 11
life 10.9
home 10.4
working 9.7
athletic facility 9.5
sitting 9.4
togetherness 9.4
senior 9.4
childhood 8.9
colleagues 8.7
couple 8.7
dad 8.5
businesspeople 8.5
face 8.5
friendship 8.4
parent 8.3
vintage 8.3
occupation 8.2
girls 8.2
children 8.2
parents 7.8
30s 7.7
diversity 7.7
old 7.7
facility 7.6
doctor 7.5
20s 7.3
laptop 7.3
hospital 7.2
worker 7.1
ball 7

Google
created on 2021-12-14

Photograph 94.1
Dress 84.6
Family reunion 76.1
Event 72.8
Vintage clothing 70.5
Crew 67.1
Stock photography 64.3
Room 61.8
Sitting 61.6
Suit 60
Picture frame 59.5
Classic 59.3
History 58.4
Team 56.8
Art 54.8
Child 52.2

Microsoft
created on 2021-12-14

person 99.6
posing 98.8
clothing 97.6
smile 92
man 91.3
human face 89.9
text 86.4
group 83.9
old 81.6
woman 79
people 77.9
black 65.3
player 61.1
cartoon 57.1
vintage 28.3
team 25.1
male 17
crowd 0.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Male, 86.1%
Sad 65.6%
Calm 34%
Angry 0.2%
Happy 0.1%
Confused 0.1%
Fear 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 33-49
Gender Male, 99.7%
Happy 99.8%
Angry 0.1%
Surprised 0%
Calm 0%
Confused 0%
Disgusted 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 28-44
Gender Female, 85.1%
Confused 84.8%
Angry 6.8%
Calm 3.7%
Disgusted 1.8%
Sad 1.4%
Surprised 1.1%
Fear 0.2%
Happy 0.1%

AWS Rekognition

Age 23-35
Gender Female, 94.6%
Happy 97.4%
Calm 0.7%
Fear 0.6%
Disgusted 0.4%
Surprised 0.3%
Angry 0.3%
Sad 0.2%
Confused 0.2%

AWS Rekognition

Age 5-15
Gender Male, 98.6%
Calm 94.3%
Sad 3.6%
Confused 0.8%
Angry 0.7%
Surprised 0.3%
Happy 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 23-35
Gender Male, 97.7%
Happy 95.8%
Calm 2.7%
Confused 0.4%
Sad 0.3%
Angry 0.3%
Surprised 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 12-22
Gender Male, 88.4%
Happy 95.1%
Calm 2.3%
Sad 1.1%
Fear 0.4%
Disgusted 0.4%
Surprised 0.3%
Confused 0.3%
Angry 0.2%

AWS Rekognition

Age 19-31
Gender Male, 98.1%
Happy 92.6%
Calm 4.5%
Surprised 1%
Angry 0.8%
Sad 0.3%
Fear 0.3%
Disgusted 0.3%
Confused 0.3%

AWS Rekognition

Age 36-52
Gender Female, 99.7%
Happy 99.9%
Surprised 0%
Angry 0%
Fear 0%
Disgusted 0%
Sad 0%
Confused 0%
Calm 0%

AWS Rekognition

Age 12-22
Gender Female, 96.7%
Happy 97.5%
Calm 1%
Disgusted 0.4%
Sad 0.3%
Angry 0.3%
Surprised 0.2%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 5-15
Gender Female, 71%
Calm 98.6%
Sad 0.4%
Happy 0.4%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 45-63
Gender Female, 99.7%
Happy 99.9%
Calm 0%
Disgusted 0%
Angry 0%
Surprised 0%
Confused 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 2-8
Gender Female, 99.6%
Sad 51.5%
Angry 34.6%
Fear 10.3%
Calm 2.1%
Happy 0.5%
Surprised 0.5%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 19-31
Gender Female, 99.7%
Sad 51.8%
Calm 41.9%
Disgusted 3.1%
Happy 1.3%
Angry 0.7%
Confused 0.5%
Fear 0.5%
Surprised 0.2%

AWS Rekognition

Age 52-70
Gender Female, 99.7%
Happy 99.5%
Calm 0.2%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Sad 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 51-69
Gender Female, 99.8%
Happy 99.8%
Calm 0.1%
Surprised 0%
Disgusted 0%
Angry 0%
Sad 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 51-69
Gender Male, 98.5%
Happy 71.5%
Calm 26.7%
Disgusted 0.5%
Surprised 0.5%
Angry 0.3%
Sad 0.3%
Confused 0.2%
Fear 0%

AWS Rekognition

Age 41-59
Gender Male, 86.3%
Happy 99.6%
Calm 0.3%
Surprised 0%
Confused 0%
Disgusted 0%
Angry 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 52-70
Gender Male, 89.9%
Happy 87.8%
Calm 10.2%
Sad 0.8%
Angry 0.3%
Disgusted 0.3%
Confused 0.3%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 36-54
Gender Female, 99%
Happy 66.5%
Calm 27%
Sad 3.4%
Fear 0.9%
Disgusted 0.6%
Angry 0.6%
Confused 0.5%
Surprised 0.4%

AWS Rekognition

Age 51-69
Gender Female, 81.3%
Happy 96.9%
Calm 2.6%
Sad 0.1%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 43-61
Gender Male, 98.3%
Happy 83.9%
Calm 13.3%
Angry 0.7%
Confused 0.5%
Sad 0.5%
Disgusted 0.5%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 24-38
Gender Female, 99.3%
Happy 99.2%
Calm 0.3%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Confused 0.1%
Sad 0%
Fear 0%

AWS Rekognition

Age 51-69
Gender Male, 83.7%
Calm 91.6%
Happy 6.2%
Sad 0.6%
Surprised 0.6%
Angry 0.5%
Disgusted 0.2%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 2-8
Gender Male, 55.7%
Sad 98.4%
Fear 0.4%
Confused 0.3%
Disgusted 0.3%
Calm 0.2%
Angry 0.2%
Happy 0.1%
Surprised 0.1%

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 8
Gender Male

Microsoft Cognitive Services

Age 61
Gender Male

Microsoft Cognitive Services

Age 17
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Person 99.7%
Person 99.6%
Person 99.5%
Person 99.1%
Person 98.4%
Person 97.7%
Person 97.1%
Person 96.7%
Person 96.6%
Person 95.5%
Person 95.2%
Person 94.9%
Person 94.6%
Person 91.6%
Person 87%
Person 84%
Person 80.8%
Person 79.8%
Person 78.3%
Person 76.3%
Person 72.6%
Person 72%
Shoe 94.1%
Shoe 86.6%

Categories

Imagga

people portraits 86.5%
pets animals 6.8%
paintings art 5.1%
nature landscape 1.4%