Human Generated Data

Title

Untitled (seated man and two little boys)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16401

Human Generated Data

Title

Untitled (seated man and two little boys)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 99
Human 99
Person 98.9
Face 98.5
Person 98.2
Clothing 95.6
Apparel 95.6
Baby 90.3
Boy 85.2
Photo 80.5
Portrait 80.5
Photography 80.5
Child 80.4
Kid 80.4
Sleeve 77.9
Drawing 73.3
Art 73.3
People 72.3
Shirt 68.3
Man 67.7
Accessories 66.5
Accessory 66.5
Sunglasses 66.5
Female 64.8
Sitting 63.6
Suit 62.9
Coat 62.9
Overcoat 62.9
Door 60.2
Girl 58.7
Head 58.6
Furniture 58.4
Play 58.1
Standing 58
Indoors 57.7
Teen 57.1
Glasses 55.9

Imagga
created on 2022-02-11

groom 40.9
person 37.7
male 31.3
people 31.2
adult 30.4
man 29.6
portrait 27.2
business 26.1
businessman 23.8
laptop 23.7
office 22.5
looking 22.4
professional 22.3
attractive 21
computer 20.8
happy 20.7
work 18.1
worker 17.8
face 17.8
suit 17.5
sitting 17.2
hair 16.6
negative 16.1
desk 16.1
smiling 15.9
indoors 15.8
holding 15.7
corporate 15.5
businesspeople 15.2
handsome 15.1
senior 15
technology 14.8
glasses 14.8
pretty 14.7
expression 14.5
clothing 14.5
casual 14.4
human 14.2
one 14.2
manager 14
indoor 13.7
businesswoman 13.6
job 13.3
executive 13.3
working 13.3
one person 13.2
lifestyle 13
lady 13
film 12.9
occupation 12.8
alone 11.9
cheerful 11.4
couple 11.3
modern 11.2
men 11.2
mature 11.2
color 11.1
happiness 11
communication 10.9
bright 10.7
smile 10.7
lab 10.7
1 10.6
medical 10.6
old 10.4
confident 10
dress 9.9
fashion 9.8
health 9.7
expertise 9.7
mid adult 9.6
education 9.5
tie 9.5
mother 9.4
notebook 9.3
model 9.3
photographic paper 9.2
20s 9.2
studio 9.1
gray 9
science 8.9
home 8.8
businessperson 8.8
40s 8.8
women 8.7
standing 8.7
love 8.7
busy 8.7
elderly 8.6
only 8.6
camera 8.3
sunglasses 8.2
bride 8.2
cute 7.9
look 7.9
good looking 7.8
laboratory 7.7
using 7.7
test 7.7
meeting 7.5
attire 7.5
wedding 7.4
light 7.3
black 7.3
student 7.2
sexy 7.2
secretary 7.2
medicine 7

Google
created on 2022-02-11

Glasses 96.8
Shirt 94.6
Smile 87
Standing 86.4
Black-and-white 83.5
Toddler 80.3
Baby 76.9
Art 75.8
Font 74.4
Monochrome 73.2
Monochrome photography 73.1
Eyewear 72
Suit 71.4
Vintage clothing 69.6
Child 67.2
Event 66.2
Room 64.6
Stock photography 64.4
Happy 63.5
Visual arts 60.1

Microsoft
created on 2022-02-11

wall 97.3
human face 96.6
person 95.9
clothing 95
text 95
toddler 89.8
baby 89.2
old 83
boy 73.5
posing 66.8
smile 58.9

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Male, 79.4%
Calm 96.1%
Happy 1.3%
Sad 1.1%
Confused 0.5%
Angry 0.3%
Disgusted 0.3%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 6-16
Gender Female, 98.2%
Calm 99.9%
Surprised 0.1%
Sad 0%
Happy 0%
Disgusted 0%
Confused 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 10-18
Gender Female, 99.1%
Calm 79.3%
Surprised 7.6%
Fear 5.6%
Sad 2.9%
Happy 2.6%
Disgusted 0.8%
Angry 0.7%
Confused 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Sunglasses 66.5%

Captions

Microsoft

a vintage photo of a man and woman posing for a picture 81.2%
a vintage photo of a man and a woman posing for a picture 81.1%
a vintage photo of a person 81%

Text analysis

Amazon

22
15
KODAK-

Google

65
65