Human Generated Data

Title

Untitled (man playing piano with Santa Claus and group of children)

Date

c.1970, printed from 1955 negative

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18233

Human Generated Data

Title

Untitled (man playing piano with Santa Claus and group of children)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

c.1970, printed from 1955 negative

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18233

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Person 99
Human 99
Person 98.8
Person 98.6
Person 98.2
Person 98.2
Person 96.2
Person 94.8
Person 93.6
Person 93.3
Building 91
Person 88.4
Factory 84.7
Person 69.5
People 68.9
Person 66.6
Workshop 57.6

Clarifai
created on 2023-10-22

people 100
group 98.9
adult 98.6
child 97.6
group together 97.4
woman 95.9
boy 95.6
many 95.5
man 95.3
war 94.9
administration 94.3
school 93.1
education 91.1
wear 88
leader 86.4
military 86.2
soldier 84.5
furniture 83.4
several 82.8
vehicle 80.6

Imagga
created on 2022-02-25

man 33.6
male 26.2
people 24.5
person 23.2
home 21.5
sitting 21.4
indoors 20.2
happy 20
room 20
adult 18.2
nurse 18
cheerful 17.9
smiling 16.6
lifestyle 16.6
interior 15.9
happiness 15.6
smile 14.9
stringed instrument 14.2
house 14.2
work 13.3
couple 13
men 12.9
computer 12.8
laptop 12.7
grand piano 12.6
family 12.4
musical instrument 12
women 11.8
team 11.6
working 11.5
group 11.3
casual 11
business 10.9
table 10.9
piano 10.8
grandfather 10.7
worker 10.7
fun 10.5
living 10.4
looking 10.4
technology 10.4
vehicle 10.3
two 10.2
keyboard instrument 10
holding 9.9
office 9.8
joy 9.2
bobsled 9.1
old 9
percussion instrument 8.8
meeting 8.5
student 8.4
enjoyment 8.4
senior 8.4
horizontal 8.4
color 8.3
sled 8.3
occupation 8.2
indoor 8.2
chair 8.1
together 7.9
leisure activity 7.8
elderly 7.6
husband 7.6
wife 7.6
togetherness 7.5
friends 7.5
outdoors 7.5
teacher 7.4
camera 7.4
lady 7.3
device 7.3
love 7.1
to 7.1
businessman 7.1
child 7.1
modern 7

Google
created on 2022-02-25

Microsoft
created on 2022-02-25

person 99.1
indoor 97.9
text 93.4
piano 87.4
black 74.5
people 73.9
group 71.4
old 67.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Male, 80.8%
Confused 92.5%
Calm 4.3%
Angry 1.4%
Disgusted 0.6%
Sad 0.6%
Happy 0.4%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 4-10
Gender Female, 100%
Fear 90.2%
Calm 3.4%
Confused 3.1%
Surprised 1.5%
Sad 0.7%
Angry 0.5%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 6-16
Gender Female, 98.5%
Surprised 37.9%
Calm 19.8%
Happy 16.4%
Confused 14.6%
Fear 5%
Sad 2.3%
Angry 2.2%
Disgusted 1.8%

AWS Rekognition

Age 10-18
Gender Female, 97.2%
Calm 99.5%
Sad 0.2%
Fear 0.1%
Surprised 0.1%
Confused 0%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 19-27
Gender Male, 99.3%
Calm 77.3%
Sad 15.5%
Confused 5.3%
Angry 0.7%
Disgusted 0.4%
Happy 0.3%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 9-17
Gender Male, 87.4%
Calm 76%
Surprised 10.2%
Confused 7.2%
Happy 1.9%
Angry 1.7%
Disgusted 1.3%
Fear 1%
Sad 0.5%

AWS Rekognition

Age 6-16
Gender Male, 52.9%
Calm 44.7%
Surprised 44.5%
Confused 4.5%
Sad 2.9%
Fear 1.5%
Angry 1%
Disgusted 0.7%
Happy 0.2%

AWS Rekognition

Age 10-18
Gender Female, 99.3%
Happy 99.8%
Sad 0.1%
Angry 0%
Surprised 0%
Disgusted 0%
Confused 0%
Fear 0%
Calm 0%

AWS Rekognition

Age 1-7
Gender Female, 100%
Happy 68.6%
Calm 17.2%
Sad 3.2%
Angry 3.1%
Surprised 2.8%
Fear 2.6%
Disgusted 1.3%
Confused 1.1%

AWS Rekognition

Age 6-14
Gender Female, 89.1%
Sad 80.6%
Confused 13.9%
Calm 3.9%
Angry 0.4%
Disgusted 0.4%
Fear 0.3%
Surprised 0.3%
Happy 0.2%

AWS Rekognition

Age 6-12
Gender Male, 85.5%
Happy 81%
Calm 6.5%
Surprised 4.9%
Sad 2.5%
Confused 2.1%
Fear 1.1%
Angry 1.1%
Disgusted 0.9%

AWS Rekognition

Age 27-37
Gender Male, 99.4%
Sad 96.4%
Calm 1.6%
Angry 1.4%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 41
Gender Male

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 6
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99%
Person 98.8%
Person 98.6%
Person 98.2%
Person 98.2%
Person 96.2%
Person 94.8%
Person 93.6%
Person 93.3%
Person 88.4%
Person 69.5%
Person 66.6%

Categories