Human Generated Data

Title

Untitled (Horse Dance, Java)
Date

January 26, 1960-February 2, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5128

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5128

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Face 100
Head 100
Photography 100
Portrait 100
People 100
Person 98.7
Adult 98.7
Male 98.7
Man 98.7
Person 98.6
Male 98.6
Boy 98.6
Child 98.6
Person 98.1
Male 98.1
Boy 98.1
Child 98.1
Person 98.1
Male 98.1
Boy 98.1
Child 98.1
Person 98
Male 98
Boy 98
Child 98
Person 97.4
Adult 97.4
Male 97.4
Man 97.4
Person 96.9
Person 95.9
Adult 95.9
Bride 95.9
Female 95.9
Wedding 95.9
Woman 95.9
Person 95.4
Person 95.1
Adult 95.1
Male 95.1
Man 95.1
Person 95.1
Person 95.1
Person 93.5
Person 93.5
Clothing 93.1
Shirt 93.1
Person 90.5
Person 89.7
Person 83.9
Person 80.6
Person 77.8
Shorts 77
Dress 65.1
Architecture 60.8
Building 60.8
Classroom 60.8
Indoors 60.8
Room 60.8
School 60.8
Happy 58
Smile 58
Pants 57
Blouse 56.4
Kindergarten 55.9
Outdoors 55.7

Clarifai
created on 2018-05-10

people 99.9
child 99.9
group 99.6
boy 98.5
son 98.4
family 97.7
group together 97.1
portrait 96.4
man 95
sibling 94.4
many 93.4
woman 92.9
adult 91.8
offspring 91.7
education 91.6
wear 91.6
facial expression 91.1
school 89.4
five 88
war 87.9

Imagga
created on 2023-10-05

man 38.3
nurse 31.6
people 31.2
kin 30.7
person 28.3
male 24.4
happy 22.5
smiling 21
couple 20.9
team 20.6
adult 19.1
businessman 18.5
business 17
group 16.9
family 16.9
together 16.6
child 16.6
happiness 15.7
senior 15
mother 14.9
portrait 14.9
lifestyle 14.4
home 14.4
mature 13.9
men 13.7
smile 12.8
medical 12.4
standing 12.2
love 11.8
worker 11.8
indoors 11.4
doctor 11.3
uniform 11.2
teamwork 11.1
women 11.1
20s 11
professional 10.9
staff 10.6
30s 10.6
medicine 10.6
four 10.5
businesspeople 10.4
day 10.2
casual 10.2
businesswoman 10
father 10
discussing 9.8
to 9.7
health 9.7
colleagues 9.7
new 9.7
parent 9.3
old 9.1
hospital 9
cheerful 8.9
job 8.8
room 8.8
discussion 8.8
daughter 8.7
work 8.6
holiday 8.6
meeting 8.5
two 8.5
student 8.4
camera 8.3
holding 8.2
occupation 8.2
care 8.2
world 8.2
life 8.2
grandfather 8.1
working 8
black 7.8
half length 7.8
40s 7.8
patient 7.7
bride 7.7
outdoor 7.6
talking 7.6
horizontal 7.5
friends 7.5
sport 7.3
classroom 7.1

Google
created on 2018-05-10

people 98.1
photograph 95.8
social group 89.8
black and white 89
standing 86.5
family 82.8
snapshot 81.8
monochrome photography 74.9
history 72.6
human behavior 71.4
child 62.7
monochrome 62.6
stock photography 56.7
vintage clothing 55.6

Microsoft
created on 2018-05-10

person 100
posing 98.8
group 96.9
standing 91.9
people 87.6
old 65
crowd 1.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-39
Gender Male, 97.3%
Calm 75%
Sad 14%
Confused 7.8%
Surprised 6.5%
Fear 6%
Angry 1.2%
Disgusted 0.7%
Happy 0.4%

AWS Rekognition

Age 6-12
Gender Male, 99.8%
Calm 68.2%
Angry 21.4%
Surprised 6.3%
Fear 6.3%
Sad 4.3%
Confused 3.5%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 14-22
Gender Male, 78.4%
Sad 44.5%
Calm 42.7%
Confused 29.5%
Surprised 6.7%
Fear 6.1%
Angry 0.5%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 4-10
Gender Male, 100%
Angry 77.7%
Sad 12%
Calm 9%
Surprised 6.3%
Fear 5.9%
Confused 0.2%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 4-10
Gender Male, 99.6%
Angry 100%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 0%
Disgusted 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 1-7
Gender Male, 61.7%
Sad 95.5%
Angry 49.3%
Surprised 6.3%
Fear 6%
Calm 1.2%
Confused 0.6%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 6-16
Gender Female, 99.8%
Angry 87.4%
Sad 9.8%
Surprised 6.3%
Fear 6%
Calm 0.4%
Disgusted 0.4%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 0-3
Gender Male, 99.9%
Calm 89%
Surprised 7.2%
Angry 6.2%
Fear 6%
Sad 2.8%
Happy 0.5%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 25-35
Gender Female, 100%
Happy 95.3%
Surprised 6.4%
Fear 6%
Sad 2.4%
Calm 1.4%
Confused 1.2%
Angry 0.3%
Disgusted 0.3%

AWS Rekognition

Age 36-44
Gender Female, 100%
Sad 99.1%
Happy 34.8%
Surprised 6.5%
Fear 6.3%
Calm 1.2%
Angry 1.1%
Disgusted 0.7%
Confused 0.5%

AWS Rekognition

Age 23-33
Gender Male, 94.8%
Calm 53%
Confused 20.2%
Angry 15.8%
Fear 7.1%
Surprised 6.8%
Sad 3.6%
Disgusted 2.5%
Happy 0.7%

AWS Rekognition

Age 18-24
Gender Male, 99.7%
Calm 93.3%
Surprised 6.7%
Fear 6.1%
Sad 2.9%
Confused 1.9%
Happy 0.6%
Angry 0.4%
Disgusted 0.2%

AWS Rekognition

Age 21-29
Gender Female, 75.9%
Calm 87.1%
Surprised 13.4%
Fear 6.3%
Sad 2.5%
Angry 0.5%
Confused 0.3%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 22-30
Gender Male, 92.6%
Calm 98.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.3%
Happy 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 21-29
Gender Male, 51.7%
Calm 73.2%
Sad 29%
Surprised 6.4%
Fear 6%
Confused 3%
Disgusted 1.8%
Angry 0.6%
Happy 0.3%

AWS Rekognition

Age 2-8
Gender Female, 99.8%
Sad 97.1%
Fear 32.7%
Surprised 12%
Confused 4.2%
Calm 2%
Happy 1.6%
Angry 1.2%
Disgusted 0.9%

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 2
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 12
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Adult 98.7%
Male 98.7%
Man 98.7%
Boy 98.6%
Child 98.6%
Bride 95.9%
Female 95.9%
Woman 95.9%
Shorts 77%

Categories

Imagga

people portraits 99.1%