Human Generated Data

Title

Untitled (mother and two children at Christmas tree)
Date

c. 1945
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.459

Human Generated Data

Title

Untitled (mother and two children at Christmas tree)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Bike 99.7
Bicycle 99.7
Vehicle 99.7
Transportation 99.7
Tree 99.1
Plant 99.1
Person 98.7
Human 98.7
Person 98
Person 95.2
Wheel 94.8
Machine 94.8
Wheel 87.3
Person 79.5
Painting 69
Art 69
Furniture 61.8
Chair 61.8
Abies 61.2
Fir 61.2
Ornament 58.7
Apparel 55.1
Clothing 55.1
Wheel 50.3

Imagga
created on 2022-01-23

rocking chair 98.9
chair 95.1
seat 66
furniture 42
tricycle 38.3
wheeled vehicle 31.4
man 22.8
vehicle 21.9
furnishing 20.8
home 20.7
people 20.1
male 18.7
senior 17.8
person 17.8
child 17.4
family 16.9
park 16.5
conveyance 15.6
sitting 15.5
old 15.3
lifestyle 15.2
happy 15
indoors 14.9
mother 14.9
wheelchair 14.6
portrait 14.2
elderly 13.4
care 13.2
interior 12.4
bench 12.2
boy 12.2
parent 12
room 12
indoor 11.9
retired 11.6
tree 11.5
couple 11.3
outdoors 11.2
mature 11.2
adult 11.1
father 11.1
day 11
smiling 10.9
medical 10.6
casual 10.2
aged 10
together 9.6
happiness 9.4
house 9.2
children 9.1
cheerful 8.9
disabled 8.9
autumn 8.8
love 8.7
retirement 8.6
holiday 8.6
illness 8.6
age 8.6
face 8.5
dad 8.4
help 8.4
leisure 8.3
teen 8.3
alone 8.2
women 7.9
disability 7.9
grandmother 7.8
couch 7.7
sick 7.7
hospital 7.7
husband 7.6
garden 7.5
wood 7.5
life 7.4
son 7.3
dress 7.2
childhood 7.2
grass 7.1
kid 7.1

Google
created on 2022-01-23

Tire 95.4
Wheel 94.5
Bicycle 90.6
Plant 90
Bicycle wheel 80.7
Tints and shades 77.2
Vintage clothing 76
Chair 74.2
Classic 69
Tree 68.4
Room 67.9
Child 67.1
Sitting 65.5
Toddler 65.4
Flowerpot 63.5
Stock photography 63.4
Picture frame 63.1
Art 62.6
Houseplant 61.4
Monochrome 58.1

Microsoft
created on 2022-01-23

wall 99
text 98.4
old 92.8
person 85.8
clothing 82.9
child 79.8
black 67.6
vintage 61.8
posing 60.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-4
Gender Female, 100%
Calm 98.1%
Surprised 0.9%
Fear 0.3%
Sad 0.2%
Happy 0.2%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 19-27
Gender Female, 99.4%
Calm 49.5%
Happy 26.9%
Surprised 7.8%
Angry 5.2%
Fear 3.5%
Sad 3.2%
Disgusted 2.6%
Confused 1.4%

AWS Rekognition

Age 0-6
Gender Female, 78.6%
Sad 91%
Calm 8%
Confused 0.4%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%
Happy 0.1%
Surprised 0.1%

Microsoft Cognitive Services

Age 1
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 3
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Bicycle 99.7%
Person 98.7%
Wheel 94.8%
Painting 69%
Chair 61.8%

Captions

Microsoft

a vintage photo of a group of people sitting posing for the camera 93.7%
a vintage photo of a group of people sitting in front of a building 93.1%
a vintage photo of a group of people posing for the camera 93%