Human Generated Data

Title

Untitled (large group of seniors posed in front of house at 100th birthday celebration)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6981

Human Generated Data

Title

Untitled (large group of seniors posed in front of house at 100th birthday celebration)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.7
Human 99.7
Person 99.6
Person 99.5
Person 99.4
Person 99.4
Person 99.4
Person 98.9
Funeral 98.4
Person 97.6
Person 92.1
Person 89.5
People 83.2
Apparel 81.5
Clothing 81.5
Outdoors 80.1
Person 79.1
Person 68.8
Nature 60.7
Countryside 59.2
Home Decor 58.6
Building 57.6
Porch 57.2
Overcoat 56
Coat 56
Person 51.2

Imagga
created on 2022-01-23

kin 24.4
private 23.4
uniform 22.6
military uniform 22
man 21.5
people 21.2
clothing 17.9
city 17.4
street 15.6
walking 15.1
travel 14.1
world 13.7
person 12.7
adult 12.3
male 12.1
men 12
military 11.6
outdoor 11.5
danger 10.9
urban 10.5
walk 10.5
old 10.4
musical instrument 10.1
dirty 9.9
history 9.8
destruction 9.8
nuclear 9.7
war 9.6
statue 9.5
consumer goods 9.1
protection 9.1
sport 9
snow 8.9
accident 8.8
women 8.7
gas 8.7
mask 8.6
sculpture 8.6
architecture 8.6
winter 8.5
black 8.4
dark 8.3
life 8.3
building 8.3
sign 8.3
pedestrian 8.2
industrial 8.2
covering 8.2
stalker 7.9
radioactive 7.9
radiation 7.8
soldier 7.8
toxic 7.8
protective 7.8
scene 7.8
chemical 7.7
tree 7.7
sky 7.6
two 7.6
outdoors 7.5
house 7.5
human 7.5
holding 7.4
park 7.4
lifestyle 7.2
weapon 7.2
trees 7.1
to 7.1
day 7.1

Google
created on 2022-01-23

Photograph 94.2
Building 93.3
Dress 91.4
House 84.5
Tree 81.4
Tints and shades 76.8
Vintage clothing 75.6
Snapshot 74.3
Event 69.7
Room 69
History 68
Classic 67.5
Plant 67.3
Pole 67.2
Art 64.4
Stock photography 64.3
Child 64.1
Sky 63.7
Monochrome 63.5
Family reunion 62.5

Microsoft
created on 2022-01-23

outdoor 99.8
person 97.1
people 93.4
standing 90.2
clothing 89.9
group 84
house 72.4
text 69.1
man 56.5
posing 49.7
old 46.7

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Female, 96.2%
Calm 69.3%
Happy 24.7%
Surprised 1.5%
Sad 1.4%
Angry 1.3%
Fear 0.7%
Disgusted 0.7%
Confused 0.5%

AWS Rekognition

Age 47-53
Gender Female, 98.2%
Sad 66.8%
Calm 25.7%
Happy 5.2%
Fear 1%
Confused 0.5%
Disgusted 0.3%
Surprised 0.3%
Angry 0.2%

AWS Rekognition

Age 48-54
Gender Female, 98.8%
Calm 72.7%
Happy 21.2%
Sad 3.1%
Fear 1.5%
Disgusted 0.7%
Angry 0.3%
Surprised 0.3%
Confused 0.2%

AWS Rekognition

Age 65-75
Gender Female, 92.6%
Calm 99.3%
Sad 0.4%
Happy 0.1%
Fear 0%
Angry 0%
Confused 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 45-51
Gender Male, 98.5%
Calm 65.8%
Sad 23.4%
Happy 6.2%
Surprised 2.2%
Disgusted 1%
Fear 0.5%
Angry 0.5%
Confused 0.4%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 76.9%
Confused 20.3%
Sad 1.6%
Angry 0.3%
Surprised 0.2%
Fear 0.2%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 54-62
Gender Female, 95.4%
Calm 87.8%
Happy 6.3%
Sad 3.9%
Confused 0.6%
Fear 0.4%
Disgusted 0.4%
Angry 0.4%
Surprised 0.3%

AWS Rekognition

Age 58-66
Gender Female, 67%
Calm 51.4%
Sad 22%
Happy 17.4%
Surprised 2.6%
Fear 2.5%
Angry 1.7%
Confused 1.5%
Disgusted 1%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Angry 77.8%
Disgusted 5.6%
Fear 4.8%
Sad 4.8%
Happy 3.3%
Calm 2.1%
Confused 1%
Surprised 0.8%

AWS Rekognition

Age 58-66
Gender Female, 55.6%
Happy 76.7%
Calm 15%
Sad 7.1%
Fear 0.3%
Disgusted 0.2%
Angry 0.2%
Surprised 0.2%
Confused 0.2%

AWS Rekognition

Age 56-64
Gender Female, 99.9%
Happy 87.9%
Calm 5.4%
Sad 2.3%
Fear 1.7%
Surprised 1.5%
Disgusted 0.5%
Angry 0.4%
Confused 0.3%

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Calm 99.6%
Sad 0.1%
Surprised 0.1%
Confused 0.1%
Fear 0.1%
Angry 0.1%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 57-65
Gender Male, 87.2%
Calm 88.3%
Happy 6.8%
Sad 1.7%
Disgusted 0.9%
Surprised 0.8%
Confused 0.6%
Angry 0.5%
Fear 0.4%

AWS Rekognition

Age 76-86
Gender Male, 99.9%
Sad 59.8%
Happy 30.4%
Calm 6.4%
Disgusted 0.9%
Fear 0.7%
Confused 0.7%
Surprised 0.6%
Angry 0.5%

AWS Rekognition

Age 58-66
Gender Male, 97.1%
Happy 75.8%
Calm 21.3%
Sad 1.5%
Surprised 0.6%
Angry 0.3%
Fear 0.2%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 49-57
Gender Female, 99.5%
Happy 80.1%
Calm 15.2%
Surprised 0.9%
Angry 0.9%
Sad 0.9%
Fear 0.7%
Confused 0.7%
Disgusted 0.7%

AWS Rekognition

Age 63-73
Gender Female, 99.9%
Happy 83%
Calm 9.1%
Sad 4.8%
Fear 0.8%
Confused 0.7%
Angry 0.6%
Disgusted 0.5%
Surprised 0.5%

AWS Rekognition

Age 71-81
Gender Female, 98.9%
Happy 62.9%
Calm 35.2%
Sad 0.6%
Surprised 0.4%
Disgusted 0.3%
Confused 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 65-75
Gender Female, 56.7%
Sad 51.6%
Confused 40.3%
Calm 2.7%
Happy 1.3%
Disgusted 1.2%
Angry 1.2%
Surprised 1%
Fear 0.7%

AWS Rekognition

Age 52-60
Gender Male, 100%
Calm 34.3%
Happy 28.6%
Sad 19.2%
Confused 10%
Fear 3%
Surprised 2.4%
Angry 1.4%
Disgusted 1.1%

AWS Rekognition

Age 51-59
Gender Female, 82.4%
Calm 97.1%
Happy 1.5%
Sad 0.6%
Angry 0.3%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 35-43
Gender Male, 99.4%
Sad 93%
Calm 2.6%
Disgusted 2.1%
Happy 0.7%
Confused 0.7%
Angry 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 25-35
Gender Female, 74%
Sad 76.9%
Angry 12.2%
Calm 7.7%
Disgusted 1.3%
Surprised 0.6%
Confused 0.5%
Fear 0.5%
Happy 0.3%

AWS Rekognition

Age 14-22
Gender Female, 96.2%
Calm 34.8%
Sad 20.7%
Angry 15.1%
Happy 12.1%
Fear 8.2%
Disgusted 4.2%
Surprised 2.7%
Confused 2.1%

AWS Rekognition

Age 38-46
Gender Male, 99.7%
Calm 80.6%
Angry 9.2%
Surprised 3.2%
Sad 2.2%
Fear 1.4%
Disgusted 1.4%
Happy 1.2%
Confused 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people standing in front of a building 98.9%
a group of people posing for a photo in front of a building 98.2%
a group of people that are standing in front of a building 98%