Human Generated Data

Title

Untitled (adults watching children play in front of fireplace)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17732

Human Generated Data

Title

Untitled (adults watching children play in front of fireplace)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.7
Human 99.7
Apparel 99.6
Clothing 99.6
Person 99.4
Person 99.1
Person 98.1
Shorts 97
Shoe 94.1
Footwear 94.1
Face 90.9
Shoe 89.6
Female 84.8
People 73.3
Coat 72.3
Suit 72.1
Overcoat 72.1
Girl 67.3
Person 67.2
Portrait 66.1
Photography 66.1
Photo 66.1
Child 65.9
Kid 65.9
Indoors 64.3
Woman 64.2
Play 62.1
Person 61.3
Room 56.7
Furniture 56.6
Chair 56.6
Performer 56.3
Crowd 55.9
Text 55.6

Imagga
created on 2022-02-26

man 33.6
kin 28.6
people 28.4
person 27.3
male 24.2
adult 19.6
portrait 14.9
lifestyle 14.4
happy 14.4
senior 14
patient 13.7
business 13.4
men 12.9
smile 12.8
human 12.7
salon 12.7
women 11.9
father 11.8
medical 11.5
black 11.4
fashion 11.3
sitting 11.2
parent 11
casual 11
grandfather 11
life 10.8
face 10.6
professional 10.6
urban 10.5
health 10.4
technology 10.4
work 10.3
brass 10.3
smiling 10.1
leisure 10
family 9.8
interior 9.7
medicine 9.7
doctor 9.4
youth 9.4
mother 9.3
old 9.1
dad 8.9
looking 8.8
couple 8.7
day 8.6
elderly 8.6
bright 8.6
nurse 8.6
equipment 8.5
modern 8.4
child 8.4
mature 8.4
city 8.3
style 8.2
mask 8.1
home 8
job 8
businessman 7.9
hair 7.9
happiness 7.8
lab 7.8
instrument 7.8
wind instrument 7.7
laboratory 7.7
test 7.7
newspaper 7.7
room 7.4
hospital 7.4
occupation 7.3
lady 7.3
music 7.3
new 7.3
chair 7.3
color 7.2
office 7.2
worker 7.2
love 7.1
musical instrument 7
look 7

Google
created on 2022-02-26

Black-and-white 84.7
Style 83.8
Font 83.1
Art 79.4
Monochrome photography 75.6
Monochrome 74.9
Event 70.7
Room 69.4
Visual arts 68.9
Vintage clothing 67.3
T-shirt 65.4
Stock photography 62
Suit 61.2
Guitar 60.7
Photographic paper 59.4
Eyewear 58.9
Fun 58.7
Music 58.4
Pattern 58.2
Painting 56.1

Microsoft
created on 2022-02-26

text 96
person 92.1
clothing 90.2
man 79.9
black and white 57.8
posing 46.6

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Male, 77.9%
Calm 93.4%
Surprised 2.1%
Sad 1.6%
Happy 1.5%
Angry 0.5%
Disgusted 0.4%
Confused 0.3%
Fear 0.2%

AWS Rekognition

Age 48-54
Gender Male, 99.9%
Happy 99.5%
Confused 0.3%
Disgusted 0.1%
Surprised 0%
Calm 0%
Angry 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 48-56
Gender Male, 99.7%
Surprised 39.2%
Confused 21.2%
Happy 15.9%
Calm 8.3%
Disgusted 7.4%
Sad 3.6%
Fear 2.8%
Angry 1.6%

AWS Rekognition

Age 24-34
Gender Female, 76.6%
Calm 96.2%
Happy 1.3%
Surprised 1.2%
Sad 0.4%
Confused 0.4%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 94.1%

Captions

Microsoft

a group of people posing for a photo 85.1%
a group of people posing for the camera 85%
a group of people posing for a picture 84.9%

Text analysis

Amazon

9
ORD
KODVK-SVEELA

Google

HAGON
VTヨヨA2-HAGON
VT
ヨヨ
A2
-