Human Generated Data

Title

Untitled (Mrs. Mills Dancing Class, girls in formation)
Date

1951, printed later
People

Artist: Francis J. Sullivan, American 1916 - 1996
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.385

Human Generated Data

Title

Untitled (Mrs. Mills Dancing Class, girls in formation)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1951, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.5
Human 99.5
Person 99.4
Person 98.6
Shorts 98.2
Clothing 98.2
Apparel 98.2
Person 98.2
Person 98
Person 97.9
Person 94.9
Dance Pose 93.3
Leisure Activities 93.3
Stage 92.7
Person 86.6
Chair 82.9
Furniture 82.9
Play 82.7
Person 80.6
Person 80.3
People 76.6
Flooring 75.7
Female 70.1
Face 68.4
Couch 66.5
Person 66.5
Kid 65.7
Child 65.7
Girl 64.5
Indoors 64
Living Room 63.2
Room 63.2
Shoe 60.7
Footwear 60.7
Floor 59.6
Portrait 59.3
Photography 59.3
Photo 59.3
Meal 57.8
Food 57.8
Sphere 57.8
Boy 56.4
Shoe 53.7

Imagga
created on 2022-01-08

ball 77
soccer ball 56.7
sport 51.1
game equipment 35
athlete 34.4
player 33
game 33
competition 31.1
person 29.4
equipment 27.7
team 26.9
fun 25.4
football 25
soccer 24
play 23.2
planner 23.1
people 22.3
man 22.2
active 21.8
action 20.4
male 19.1
exercise 19
fitness 19
athletic 17.2
group 16.9
field 16.7
goal 16.3
adult 15.6
recreation 15.2
outdoors 14.9
players 14.8
kick 14.6
playing 14.6
grass 14.2
boy 13.9
child 13.7
run 13.5
activity 13.4
sports 12.9
black 12.6
win 12.4
lifestyle 12.3
dance 12.1
men 12
training 12
portrait 11.6
practice 11.6
foot 11.4
net 11.4
event 11.1
youth 11.1
leisure 10.8
healthy 10.7
outdoor 10.7
women 10.3
girls 10
runner 9.7
match 9.6
running 9.6
stadium 9.3
dancer 9.2
attractive 9.1
happy 8.8
cute 8.6
smile 8.5
friends 8.4
teamwork 8.3
fashion 8.3
speed 8.2
teenager 8.2
childhood 8.1
body 8
world 8
pitch 7.9
athletics 7.9
compete 7.8
court 7.8
champion 7.8
winning 7.8
winner 7.7
power 7.5
dark 7.5
teen 7.3
clothing 7.3
smiling 7.2
gymnasium 7.1
kid 7.1
summer 7.1
together 7

Google
created on 2022-01-08

Smile 91
Font 79.8
Happy 73.9
Gesture 72.6
Event 70.8
Dance 67.6
Team sport 67
Performing arts 66.7
Crew 66.2
Stock photography 64.2
Monochrome 63.3
Entertainment 63.2
Team 61.7
Monochrome photography 58.8
Sports 58.4
Photo caption 57.5

Microsoft
created on 2022-01-08

posing 97.8
text 97.7
person 94.8
window 91.1
clothing 89.1
footwear 79.5
smile 75.6
boy 61.3
team 43.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-10
Gender Female, 99.6%
Calm 99.8%
Happy 0.1%
Confused 0%
Sad 0%
Angry 0%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 4-10
Gender Male, 100%
Happy 93.6%
Calm 2.3%
Surprised 1.6%
Confused 1.1%
Angry 0.5%
Sad 0.3%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 4-12
Gender Male, 100%
Calm 94.8%
Happy 2.9%
Confused 1%
Sad 0.5%
Disgusted 0.4%
Angry 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 1-7
Gender Male, 97.6%
Happy 98.6%
Calm 0.8%
Surprised 0.2%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 0-4
Gender Female, 98.7%
Calm 90.9%
Angry 2.5%
Confused 2.3%
Sad 1.7%
Disgusted 1.3%
Surprised 0.6%
Happy 0.5%
Fear 0.2%

AWS Rekognition

Age 1-7
Gender Female, 98.3%
Happy 99.6%
Surprised 0.2%
Fear 0.1%
Confused 0%
Angry 0%
Disgusted 0%
Sad 0%
Calm 0%

AWS Rekognition

Age 4-10
Gender Female, 99.9%
Happy 97.5%
Surprised 1.1%
Calm 0.7%
Confused 0.2%
Disgusted 0.2%
Angry 0.2%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 1-7
Gender Female, 100%
Happy 97.1%
Surprised 2.2%
Calm 0.2%
Confused 0.2%
Angry 0.1%
Sad 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 4-12
Gender Male, 62.3%
Calm 98.7%
Happy 0.8%
Confused 0.2%
Surprised 0.1%
Sad 0.1%
Angry 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 0-4
Gender Female, 100%
Calm 88.2%
Happy 6.4%
Surprised 1.8%
Confused 1.2%
Angry 0.9%
Disgusted 0.7%
Sad 0.4%
Fear 0.4%

AWS Rekognition

Age 0-4
Gender Female, 91.3%
Happy 93.9%
Surprised 5.7%
Confused 0.1%
Fear 0.1%
Angry 0.1%
Calm 0.1%
Sad 0%
Disgusted 0%

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 1
Gender Male

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 2
Gender Female

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 5
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Shoe 60.7%

Captions

Microsoft

a group of people posing for a photo 94.3%
a group of people posing for a picture 94.2%
a group of people posing for the camera 94.1%