Human Generated Data

Title

Untitled (six generations: three women, two men, and baby in living room in front of clock)

Date

c. 1945

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6970

Human Generated Data

Title

Untitled (six generations: three women, two men, and baby in living room in front of clock)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Accessory 99.2
Accessories 99.2
Tie 99.2
Tie 98.7
Human 98.6
People 98.6
Family 98.6
Person 97.6
Chair 96.6
Furniture 96.6
Person 95.6
Person 93.9
Person 93
Person 92.7
Clothing 80.5
Suit 80.5
Overcoat 80.5
Apparel 80.5
Coat 80.5
Suit 76.5

Imagga
created on 2022-01-23

man 41
male 31.9
people 30.1
person 27.1
groom 25.7
couple 24.4
adult 22.4
business 21.9
businessman 21.2
men 18.9
portrait 18.8
suit 18.7
executive 17.7
kin 17.6
happy 17.5
happiness 17.2
dress 17.2
smile 17.1
two 16.9
senior 16.9
clothing 15.9
old 15.3
office 15.3
fashion 15.1
women 15
professional 14.7
handsome 14.3
life 14.2
corporate 13.7
smiling 13.7
confident 13.6
family 13.3
tie 13.3
job 13.3
mature 13
garment 12.7
love 12.6
bride 12.5
meeting 12.2
cheerful 12.2
bow tie 11.8
together 11.4
career 11.4
worker 11.2
room 11.2
home 11.2
work 11.1
wedding 11
married 10.5
indoors 10.5
elderly 10.5
standing 10.4
musical instrument 10
husband 9.8
interior 9.7
marriage 9.5
bouquet 9.4
manager 9.3
wind instrument 9.2
businesswoman 9.1
romantic 8.9
group 8.9
looking 8.8
lifestyle 8.7
sitting 8.6
businesspeople 8.5
attractive 8.4
future 8.4
hand 8.4
inside 8.3
holding 8.3
occupation 8.2
care 8.2
indoor 8.2
kimono 8.1
romance 8
medical 7.9
hands 7.8
modern 7.7
teacher 7.7
casual 7.6
chair 7.6
wife 7.6
waiter 7.5
city 7.5
outdoors 7.5
robe 7.4
style 7.4
successful 7.3
lady 7.3
new 7.3
building 7.2
team 7.2
face 7.1
oboe 7

Google
created on 2022-01-23

Photograph 94.2
Tie 87
Chair 86.7
Standing 86.4
Suit 81.2
Classic 77.5
Vintage clothing 76.1
Snapshot 74.3
Picture frame 70.8
Event 70.6
Lap 69.2
Sitting 67.4
History 67.1
Monochrome 66.7
Formal wear 66.1
Stock photography 64.5
Hat 58.5
Retro style 57.9
Art 56.7
Family reunion 54.9

Microsoft
created on 2022-01-23

person 99.3
clothing 99
smile 96
text 93.8
suit 88.8
old 87.8
man 85
human face 83.4
woman 76
dress 72.5
group 71.1
posing 60.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-56
Gender Male, 100%
Calm 43.7%
Confused 22.5%
Fear 14.1%
Surprised 7.9%
Sad 5%
Angry 3%
Disgusted 2.4%
Happy 1.5%

AWS Rekognition

Age 22-30
Gender Female, 97.5%
Calm 100%
Surprised 0%
Happy 0%
Disgusted 0%
Confused 0%
Angry 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 39-47
Gender Male, 99.8%
Calm 98%
Angry 0.8%
Surprised 0.4%
Disgusted 0.2%
Fear 0.2%
Confused 0.2%
Sad 0.2%
Happy 0.1%

AWS Rekognition

Age 37-45
Gender Male, 100%
Calm 89.8%
Confused 8%
Surprised 0.7%
Angry 0.5%
Sad 0.3%
Disgusted 0.3%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 71-81
Gender Male, 75.1%
Calm 75%
Surprised 13.8%
Disgusted 4.9%
Angry 1.8%
Happy 1.5%
Confused 1.4%
Fear 0.9%
Sad 0.7%

AWS Rekognition

Age 0-3
Gender Female, 55.1%
Calm 87.9%
Disgusted 6%
Happy 4.1%
Angry 0.8%
Surprised 0.5%
Confused 0.3%
Sad 0.2%
Fear 0.2%

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 69
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 12
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.2%
Person 97.6%
Suit 80.5%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 97.4%
a vintage photo of a group of people posing for a picture 97.3%
a group of people posing for a photo 97.2%