Human Generated Data

Title

Square dance, Skyline Farms, Alabama

Date

1937

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3114

Human Generated Data

Title

Square dance, Skyline Farms, Alabama

People

Artist: Ben Shahn, American 1898 - 1969

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.8
Human 99.8
Person 99.6
Person 99.6
Person 99.6
Person 99
Person 98.9
Person 97.2
Toy 95.5
Hula 95.5
Person 91.1
Person 88.5
Person 86.4
Leisure Activities 82.8
Person 73.1
Dance 58.5

Imagga
created on 2021-12-15

sky 23
male 21.3
man 20.8
rope 19.3
work 18.5
sport 18.1
active 17.4
summer 17.4
backboard 16.7
wicker 16.7
people 16.2
water 15.3
person 15.2
adult 14.9
line 14.8
equipment 14.8
beach 14.6
outdoors 14.3
fitness 13.6
sea 13.3
sand 13.1
competition 12.8
travel 12.7
tennis 12.7
court 12.7
outdoor 12.2
athlete 12.2
product 12.2
fun 12
exercise 11.8
day 11.8
lifestyle 11.6
ocean 10.8
men 10.3
child 10.2
healthy 10.1
happy 10
vacation 9.8
sexy 9.6
ball 9.3
clouds 9.3
sports 9.2
house 9.2
racket 9.2
health 9
recreation 9
lady 8.9
creation 8.8
happiness 8.6
outside 8.6
attractive 8.4
landscape 8.2
dress 8.1
sunset 8.1
activity 8.1
game 8
love 7.9
guy 7.9
boy 7.8
play 7.8
old 7.7
relax 7.6
joy 7.5
human 7.5
action 7.4
sun 7.2
net 7.2
holiday 7.2
player 7.2
adolescent 7.1
working 7.1

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

text 98.5
person 95.7
outdoor 92
playground 84
clothing 71
child 64.3
footwear 64
man 63
boy 55.5
baseball 51.1
old 41.4

Face analysis

Amazon

Google

AWS Rekognition

Age 20-32
Gender Male, 92.7%
Calm 88.3%
Angry 4.3%
Happy 3.2%
Sad 2.8%
Fear 0.5%
Confused 0.4%
Surprised 0.3%
Disgusted 0.1%

AWS Rekognition

Age 38-56
Gender Female, 73.1%
Calm 99.2%
Happy 0.7%
Sad 0%
Angry 0%
Surprised 0%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 35-51
Gender Male, 98%
Calm 46.5%
Sad 24.5%
Disgusted 16.3%
Angry 4.6%
Confused 4.1%
Fear 1.7%
Happy 1.4%
Surprised 0.8%

AWS Rekognition

Age 38-56
Gender Male, 87.5%
Calm 55.2%
Sad 17.9%
Angry 12.8%
Confused 6.2%
Surprised 3.3%
Disgusted 1.8%
Fear 1.5%
Happy 1.4%

AWS Rekognition

Age 35-51
Gender Male, 78.8%
Sad 54%
Calm 35.1%
Angry 3.5%
Confused 3.1%
Fear 1.6%
Disgusted 1.3%
Happy 0.7%
Surprised 0.7%

AWS Rekognition

Age 30-46
Gender Female, 85.6%
Calm 96.9%
Sad 2.3%
Happy 0.2%
Confused 0.2%
Angry 0.1%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 8-18
Gender Female, 78.7%
Calm 71.9%
Sad 18.2%
Angry 6.2%
Happy 1.7%
Confused 0.9%
Fear 0.5%
Disgusted 0.4%
Surprised 0.2%

AWS Rekognition

Age 13-25
Gender Female, 95.7%
Happy 83%
Calm 6.3%
Angry 2.6%
Surprised 2.2%
Fear 2%
Confused 1.5%
Sad 1.2%
Disgusted 1.1%

AWS Rekognition

Age 22-34
Gender Male, 70%
Sad 80.3%
Calm 15.9%
Happy 2.7%
Angry 0.5%
Fear 0.2%
Confused 0.2%
Surprised 0.1%
Disgusted 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people posing for a photo 85.6%
a group of people posing for a picture 85.5%
a group of people posing for the camera 85.4%