Human Generated Data

Title

Untitled (two girls racing on hoby horses at a Ball)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5664

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two girls racing on hoby horses at a Ball)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.7
Human 99.7
Person 99.5
Person 95.8
Person 94.1
Person 92.9
Person 91
Leisure Activities 90.8
Dance Pose 89.5
Interior Design 89.3
Indoors 89.3
Person 88.8
Person 85.8
Person 84.4
Person 81.9
Room 81.6
People 79
Person 78
Clothing 76.6
Footwear 76.6
Apparel 76.6
Shoe 76.6
Crowd 70.2
Dance 69.3
Sports 68.6
Sport 68.6
Skateboard 68.6
Person 65.5
Person 62.9
Shoe 57.9
Carousel 56.9
Amusement Park 56.9
Person 43.2
Person 43.2

Imagga
created on 2021-12-15

bowed stringed instrument 30.5
man 29.6
stringed instrument 27
violin 26.4
musical instrument 22.7
silhouette 22.3
sport 22.1
person 20.1
people 19.5
male 19.1
black 16.2
player 15.3
business 15.2
team 13.4
active 12.9
group 12.9
competition 12.8
ball 12.4
businessman 12.4
men 12
fun 12
exercise 11.8
adult 11.3
city 10.8
recreation 10.7
drawing 10.4
motion 10.3
lifestyle 10.1
performer 10
fitness 9.9
job 9.7
women 9.5
play 9.5
action 9.3
speed 9.2
teenager 9.1
cello 9
athlete 9
success 8.8
happy 8.8
jump 8.6
work 8.6
teacher 8.5
grunge 8.5
career 8.5
finance 8.4
power 8.4
dancer 8.2
outdoors 8.2
art 8.2
style 8.2
activity 8.1
design 7.9
professional 7.9
urban 7.9
guitar 7.8
crowd 7.7
youth 7.7
walking 7.6
dance 7.4
music 7.2
game 7.1
world 7.1
happiness 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

Face analysis

Amazon

Google

AWS Rekognition

Age 29-45
Gender Male, 54.6%
Calm 89.9%
Happy 4.8%
Sad 4.3%
Confused 0.4%
Angry 0.2%
Surprised 0.2%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 45-63
Gender Female, 51%
Calm 54.5%
Sad 34.8%
Happy 7.6%
Angry 1.2%
Confused 1.1%
Surprised 0.4%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 28-44
Gender Male, 58.7%
Happy 52.4%
Calm 40%
Sad 5.3%
Confused 1.1%
Surprised 0.7%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 49-67
Gender Female, 95.8%
Happy 53.6%
Calm 33.6%
Sad 7.5%
Confused 3.1%
Surprised 1.3%
Angry 0.5%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 52-70
Gender Male, 85.5%
Happy 58%
Calm 39%
Sad 1.9%
Confused 0.4%
Surprised 0.3%
Angry 0.3%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 26-42
Gender Female, 64.2%
Sad 63%
Calm 35%
Happy 0.7%
Confused 0.6%
Angry 0.4%
Fear 0.2%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 50-68
Gender Female, 60.8%
Calm 83.2%
Sad 15.2%
Happy 0.4%
Angry 0.4%
Surprised 0.3%
Confused 0.3%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 36-54
Gender Male, 78.7%
Calm 77.1%
Sad 8.3%
Confused 6.8%
Happy 5.7%
Surprised 1.1%
Angry 0.6%
Disgusted 0.3%
Fear 0.1%

AWS Rekognition

Age 32-48
Gender Female, 50.4%
Sad 78.7%
Calm 10.4%
Confused 6.1%
Happy 2.3%
Angry 0.9%
Surprised 0.7%
Fear 0.5%
Disgusted 0.3%

AWS Rekognition

Age 21-33
Gender Female, 74.2%
Calm 53.7%
Sad 30.1%
Confused 3.7%
Surprised 3.6%
Happy 3%
Angry 2.8%
Fear 2.5%
Disgusted 0.6%

AWS Rekognition

Age 26-42
Gender Female, 62.9%
Sad 66.7%
Calm 18.8%
Happy 10.9%
Confused 2.4%
Angry 0.7%
Fear 0.3%
Surprised 0.2%
Disgusted 0.1%

AWS Rekognition

Age 50-68
Gender Female, 72.4%
Sad 53.3%
Calm 38%
Happy 3.6%
Angry 3.5%
Confused 0.7%
Fear 0.5%
Surprised 0.2%
Disgusted 0.1%

AWS Rekognition

Age 42-60
Gender Male, 94.3%
Surprised 47.8%
Calm 17.8%
Happy 16.8%
Disgusted 13.5%
Angry 1.7%
Fear 1.2%
Confused 0.8%
Sad 0.4%

AWS Rekognition

Age 29-45
Gender Female, 65.6%
Happy 60.1%
Calm 18.9%
Sad 8.4%
Confused 6.2%
Angry 3.3%
Fear 1.2%
Surprised 1.1%
Disgusted 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.7%
Shoe 76.6%
Skateboard 68.6%

Captions

Microsoft

a group of people in a room 93.3%
a group of people standing in a room 91.3%
a group of people around each other 82.1%

Text analysis

Amazon

FINISH
13858

Google

13858
13858·
MAMT2A3
13858 FINISH 13858· MAMT2A3
FINISH