Human Generated Data

Title

Untitled (costumed girls dancing in a circle on stage)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5666

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (costumed girls dancing in a circle on stage)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.5
Human 99.5
Person 98.8
Person 98.3
Person 98.1
Dance Pose 95.4
Leisure Activities 95.4
Person 93.2
Person 92.3
Sport 91.6
Sports 91.6
Person 90.4
Person 84.5
Person 82.7
Person 79.7
Clothing 78
Apparel 78
Shoe 78
Footwear 78
Person 76.9
Person 76.4
Person 74.1
Female 71.5
Person 70.3
Skating 67
Girl 61.6
Crowd 61.1
Ice Skating 59
Person 46.1
Person 43.4

Imagga
created on 2021-12-15

swimsuit 32
people 31.2
group 25.8
pedestrian 25.3
silhouette 24.8
swimming trunks 24.6
garment 23.9
sport 21.6
beach 19.6
crowd 19.2
clothing 17.9
men 17.2
male 17
person 16.6
sea 16.4
man 15.4
summer 15.4
water 15.3
landscape 14.9
outdoor 14.5
outdoors 14.3
walking 14.2
travel 14.1
sky 14
athlete 13.4
vacation 13.1
runner 13
art 12.8
winter 12.8
active 12.8
ocean 12.4
lake 12.4
lifestyle 12.3
covering 11.9
adult 11.9
women 11.9
leisure 11.6
black 11.4
sand 11.3
sun 11.3
fun 11.2
snow 10.9
maillot 10.8
sunset 10.8
run 10.6
many 10.1
happy 10
consumer goods 9.9
body 9.6
animal 9.6
action 9.3
dance 9.1
park 9.1
coast 9
urban 8.7
couple 8.7
business 8.5
clouds 8.4
tourist 8.4
old 8.4
city 8.3
brass 8.3
life 8.3
tourism 8.2
horizon 8.1
team 8.1
grass 7.9
wild 7.8
cold 7.7
youth 7.7
relax 7.6
free 7.5
sunrise 7.5
bird 7.4
girls 7.3
exercise 7.3
copy space 7.2
contestant 7.2
recreation 7.2

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

outdoor 99.4
text 98.5
dance 97.1
person 96
clothing 90.9
posing 85.3
group 72.9
people 72.5
sport 65.7
footwear 64.7
woman 52.5
team 25.3

Face analysis

Amazon

Google

AWS Rekognition

Age 23-37
Gender Male, 55.5%
Sad 56.3%
Calm 29.4%
Fear 5.7%
Angry 5.1%
Happy 2.5%
Confused 0.4%
Surprised 0.4%
Disgusted 0.2%

AWS Rekognition

Age 23-35
Gender Female, 78.1%
Happy 75.4%
Sad 15.2%
Calm 4.5%
Surprised 2.1%
Confused 1.3%
Fear 1%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 36-54
Gender Male, 70.4%
Happy 78%
Calm 13.5%
Sad 3%
Confused 1.9%
Angry 1.8%
Fear 0.7%
Surprised 0.6%
Disgusted 0.5%

AWS Rekognition

Age 52-70
Gender Male, 85.8%
Calm 44.4%
Sad 32.6%
Happy 19.8%
Angry 1.3%
Confused 1.1%
Fear 0.4%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 37-55
Gender Male, 87.3%
Calm 38.2%
Sad 27.8%
Happy 27.6%
Confused 3.5%
Angry 1.7%
Surprised 0.5%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 43-61
Gender Male, 83.5%
Calm 55.8%
Sad 31.7%
Happy 7.1%
Angry 2.5%
Confused 2.2%
Fear 0.3%
Surprised 0.2%
Disgusted 0.1%

AWS Rekognition

Age 38-56
Gender Female, 58.3%
Calm 28.6%
Fear 18%
Sad 17.9%
Angry 15.9%
Surprised 9.2%
Confused 4.5%
Happy 4.3%
Disgusted 1.5%

AWS Rekognition

Age 50-68
Gender Female, 83.5%
Calm 80.3%
Sad 12%
Happy 7.3%
Confused 0.1%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 28-44
Gender Female, 94.2%
Happy 45.4%
Calm 45.1%
Sad 6.3%
Confused 1%
Angry 0.9%
Fear 0.5%
Surprised 0.4%
Disgusted 0.3%

AWS Rekognition

Age 37-55
Gender Male, 91.1%
Calm 49.4%
Angry 31%
Happy 9.2%
Sad 3.7%
Confused 2.4%
Surprised 2%
Disgusted 1.5%
Fear 0.6%

AWS Rekognition

Age 32-48
Gender Male, 57.6%
Happy 61.8%
Calm 34.1%
Sad 3.3%
Angry 0.4%
Confused 0.2%
Surprised 0.2%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 31-47
Gender Female, 77.3%
Calm 38.6%
Happy 22.5%
Sad 17.6%
Angry 13.4%
Confused 4.7%
Fear 1.2%
Disgusted 1.1%
Surprised 0.9%

AWS Rekognition

Age 51-69
Gender Female, 90.2%
Calm 66%
Happy 15%
Sad 7.9%
Confused 3.4%
Angry 2.5%
Surprised 2.3%
Fear 1.7%
Disgusted 1.2%

AWS Rekognition

Age 12-22
Gender Female, 75.4%
Fear 73.1%
Surprised 9%
Calm 6.2%
Confused 5.2%
Sad 4.2%
Happy 1.2%
Angry 0.7%
Disgusted 0.3%

AWS Rekognition

Age 39-57
Gender Female, 75.1%
Calm 62.8%
Happy 33.3%
Sad 3.3%
Confused 0.2%
Surprised 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 50-68
Gender Male, 52%
Happy 44%
Sad 24.2%
Calm 18.3%
Angry 6.5%
Confused 2.7%
Fear 2.4%
Surprised 1.4%
Disgusted 0.4%

AWS Rekognition

Age 30-46
Gender Female, 86.9%
Calm 52.5%
Sad 22%
Happy 12.7%
Fear 4.4%
Angry 3.6%
Confused 2.9%
Surprised 1.4%
Disgusted 0.7%

AWS Rekognition

Age 43-61
Gender Female, 66.5%
Sad 40.6%
Calm 29.7%
Disgusted 9.4%
Confused 7.1%
Fear 4.7%
Happy 3.3%
Angry 2.9%
Surprised 2.4%

AWS Rekognition

Age 19-31
Gender Female, 82.3%
Sad 89.8%
Calm 5.2%
Happy 3%
Disgusted 1.4%
Confused 0.3%
Angry 0.2%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 48-66
Gender Female, 63.8%
Calm 62.6%
Sad 33%
Happy 2.3%
Confused 0.7%
Angry 0.5%
Fear 0.5%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 46-64
Gender Female, 77.2%
Calm 76%
Sad 13.7%
Happy 9.2%
Confused 0.4%
Angry 0.3%
Surprised 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 21-33
Gender Male, 62.6%
Calm 42.9%
Happy 28.7%
Sad 17.6%
Confused 7.4%
Surprised 1.5%
Angry 1.3%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 20-32
Gender Female, 92%
Happy 64.2%
Calm 23.2%
Sad 6.9%
Angry 2.2%
Confused 1.4%
Surprised 1.1%
Fear 0.8%
Disgusted 0.3%

AWS Rekognition

Age 30-46
Gender Female, 92.6%
Happy 66.4%
Calm 25.8%
Sad 3.4%
Surprised 1.8%
Fear 1.4%
Disgusted 0.5%
Confused 0.4%
Angry 0.3%

AWS Rekognition

Age 52-70
Gender Female, 68%
Sad 77.8%
Calm 17.1%
Fear 1.8%
Confused 1.1%
Happy 1%
Angry 0.6%
Surprised 0.5%
Disgusted 0.2%

AWS Rekognition

Age 21-33
Gender Female, 50.7%
Calm 55.9%
Happy 19.4%
Sad 17.7%
Angry 3.8%
Confused 2.1%
Surprised 0.6%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 15-27
Gender Female, 57.4%
Calm 63%
Sad 27.2%
Confused 3.8%
Happy 3.4%
Angry 1.6%
Disgusted 0.3%
Fear 0.3%
Surprised 0.3%

AWS Rekognition

Age 20-32
Gender Female, 71.4%
Calm 52.8%
Sad 28.1%
Happy 12.2%
Angry 3.1%
Fear 2%
Confused 0.8%
Surprised 0.7%
Disgusted 0.3%

AWS Rekognition

Age 14-26
Gender Female, 57%
Calm 56.7%
Happy 33.1%
Sad 7.4%
Confused 1.2%
Angry 0.7%
Fear 0.3%
Disgusted 0.3%
Surprised 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Shoe 78%

Captions

Microsoft

a group of people posing for a photo 97.9%
a group of people posing for the camera 97.8%
a group of people posing for a picture 97.7%

Text analysis

Amazon

13876

Google

13876.
13876. 13876.