Human Generated Data

Title

Untitled (large group of seniors posed in front of house at 100th birthday celebration)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6980

Human Generated Data

Title

Untitled (large group of seniors posed in front of house at 100th birthday celebration)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.7
Person 99.7
Person 99.6
Person 99.5
Person 99.5
Person 99.4
Person 99.3
Funeral 99.3
Person 98.6
Person 95.7
Person 95.3
Person 90.6
Person 88.7
People 79.4
Person 70.6
Clothing 66.7
Apparel 66.7
Person 60.8
Coat 58.8

Imagga
created on 2022-01-23

people 21.2
man 20.1
city 18.3
private 15.8
person 14.9
urban 14.8
travel 14.8
uniform 14.7
walking 14.2
street 13.8
world 13.2
men 12.9
architecture 12.6
history 12.5
building 12.3
outdoors 11.4
male 11.3
life 11.1
business 10.9
danger 10.9
industrial 10.9
dark 10.9
destruction 10.7
nuclear 10.7
group 10.5
old 10.4
military uniform 10.4
adult 10.4
clothing 10.4
women 10.3
outdoor 9.9
black 9.7
military 9.7
kin 9.6
walk 9.5
monument 9.3
protection 9.1
sky 8.9
spectator 8.7
statue 8.7
gas 8.7
scene 8.7
sport 8.6
mask 8.6
silhouette 8.3
human 8.2
park 8.2
dirty 8.1
lifestyle 7.9
radioactive 7.9
radiation 7.8
toxic 7.8
protective 7.8
chemical 7.7
war 7.7
sign 7.5
track 7.5
tourist 7.4
historic 7.3
speed 7.3
square 7.2
road 7.2
transportation 7.2
religion 7.2
trees 7.1
sidewalk 7.1
summer 7.1
weapon 7

Google
created on 2022-01-23

Dress 92.6
Building 91.3
Plant 87.6
Standing 86.4
Tree 84.4
House 83
Headgear 81.4
Adaptation 79.4
Tints and shades 77
Vintage clothing 75.2
Event 70.6
History 68.8
Pole 68.2
Room 66.6
Monochrome 65.5
Family reunion 65.3
Cottage 64.6
Child 63.7
Classic 61.2
Plantation 60.9

Microsoft
created on 2022-01-23

outdoor 99.9
person 94.6
standing 91.7
people 87.2
group 85.7
clothing 84.5
house 76.2
text 69.9
posing 41.4

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Female, 96.9%
Sad 84.3%
Happy 7.2%
Angry 2.5%
Calm 2.3%
Disgusted 2.1%
Surprised 0.6%
Fear 0.5%
Confused 0.4%

AWS Rekognition

Age 61-71
Gender Female, 99.4%
Calm 42.5%
Happy 41.2%
Sad 10.3%
Confused 1.8%
Surprised 1.2%
Fear 1.2%
Disgusted 1%
Angry 0.8%

AWS Rekognition

Age 45-53
Gender Female, 99.3%
Sad 46.5%
Calm 44.9%
Fear 2.6%
Angry 1.9%
Confused 1.7%
Disgusted 0.9%
Surprised 0.8%
Happy 0.6%

AWS Rekognition

Age 37-45
Gender Female, 96%
Happy 99.2%
Fear 0.3%
Sad 0.2%
Calm 0.1%
Angry 0.1%
Surprised 0.1%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 60-70
Gender Male, 91.2%
Calm 88.6%
Sad 10.4%
Angry 0.5%
Fear 0.2%
Confused 0.1%
Happy 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 54-64
Gender Female, 92.8%
Sad 87.3%
Calm 5.3%
Fear 3.6%
Surprised 1.4%
Confused 0.8%
Disgusted 0.7%
Happy 0.5%
Angry 0.4%

AWS Rekognition

Age 58-66
Gender Male, 99.5%
Calm 76.9%
Fear 6.2%
Happy 5.5%
Surprised 4%
Confused 3.1%
Sad 1.9%
Disgusted 1.3%
Angry 1.2%

AWS Rekognition

Age 53-61
Gender Male, 93.9%
Calm 55.2%
Sad 30.6%
Confused 3.3%
Fear 3.1%
Happy 2.7%
Angry 2%
Disgusted 1.7%
Surprised 1.4%

AWS Rekognition

Age 61-71
Gender Male, 93.4%
Sad 57.2%
Calm 14.7%
Fear 11.2%
Surprised 7%
Happy 4.7%
Angry 2.7%
Disgusted 1.5%
Confused 1%

AWS Rekognition

Age 50-58
Gender Male, 99.6%
Sad 86.2%
Calm 8.2%
Angry 2.3%
Disgusted 1.2%
Surprised 0.8%
Fear 0.6%
Happy 0.4%
Confused 0.4%

AWS Rekognition

Age 57-65
Gender Female, 83.2%
Calm 90.4%
Happy 5%
Sad 3%
Surprised 0.5%
Angry 0.3%
Disgusted 0.3%
Fear 0.3%
Confused 0.3%

AWS Rekognition

Age 76-86
Gender Female, 98.8%
Calm 65.4%
Happy 26.3%
Surprised 2.8%
Disgusted 2%
Sad 1.8%
Angry 1%
Confused 0.5%
Fear 0.4%

AWS Rekognition

Age 65-75
Gender Male, 94%
Calm 99%
Sad 0.4%
Angry 0.3%
Happy 0.2%
Fear 0.1%
Disgusted 0.1%
Confused 0%
Surprised 0%

AWS Rekognition

Age 60-70
Gender Male, 100%
Calm 88.5%
Sad 4.5%
Angry 2.4%
Happy 1.5%
Surprised 1.1%
Fear 0.9%
Confused 0.6%
Disgusted 0.5%

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 65.2%
Confused 32.4%
Sad 1.1%
Fear 1%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 54-64
Gender Male, 61.3%
Calm 98.8%
Surprised 0.5%
Sad 0.2%
Confused 0.2%
Fear 0.1%
Angry 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 48-54
Gender Female, 95.9%
Happy 64.2%
Calm 28.8%
Sad 5.1%
Disgusted 0.6%
Fear 0.5%
Confused 0.3%
Surprised 0.2%
Angry 0.2%

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Calm 48.6%
Happy 44.5%
Sad 3.3%
Disgusted 1.6%
Surprised 0.6%
Fear 0.6%
Angry 0.5%
Confused 0.4%

AWS Rekognition

Age 51-59
Gender Male, 97.6%
Calm 77.7%
Sad 17.2%
Happy 1.8%
Surprised 1.1%
Confused 0.9%
Angry 0.6%
Disgusted 0.5%
Fear 0.3%

AWS Rekognition

Age 22-30
Gender Male, 98.6%
Calm 26.2%
Happy 22.9%
Sad 18.9%
Fear 12%
Angry 7.7%
Surprised 4.9%
Disgusted 4%
Confused 3.4%

AWS Rekognition

Age 34-42
Gender Female, 90.8%
Calm 72.5%
Happy 24.7%
Disgusted 1.1%
Sad 0.5%
Confused 0.4%
Surprised 0.3%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 54-64
Gender Male, 51.8%
Sad 45%
Confused 29%
Happy 13%
Disgusted 4.1%
Angry 3.6%
Surprised 2.9%
Calm 1.2%
Fear 1.2%

AWS Rekognition

Age 34-42
Gender Male, 99.8%
Sad 53.1%
Confused 15.2%
Calm 13.6%
Fear 8.9%
Surprised 3.1%
Happy 3.1%
Disgusted 2.2%
Angry 0.9%

AWS Rekognition

Age 23-31
Gender Male, 91.4%
Calm 73.2%
Disgusted 10.8%
Fear 4.5%
Surprised 4%
Angry 2.6%
Happy 2.5%
Sad 1.7%
Confused 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people standing in front of a building 98.9%
a group of people posing for a photo in front of a building 98.3%
a group of people that are standing in front of a building 98%