Human Generated Data

Title

Untitled (boy and girl, seated, wearing formal attire)
Date

1962
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16491

Human Generated Data

Title

Untitled (boy and girl, seated, wearing formal attire)

People

Artist: Lucian and Mary Brown, American

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Human 99.4
Person 99.4
Person 98.7
Clothing 86.7
Apparel 86.7
Sitting 86.3
Female 82
Furniture 76.9
Accessories 67.2
Accessory 67.2
Tie 67.2
Girl 63
Woman 60.9
Finger 60.6
Suit 59.4
Overcoat 59.4
Coat 59.4
Meal 58.7
Food 58.7
Kid 58.2
Teen 58.2
Child 58.2
Blonde 58.2
Sleeve 57.2
Drawing 56.7
Art 56.7
Dating 56.1

Imagga
created on 2022-02-11

man 44.4
male 41.2
people 36.3
person 35.7
businessman 30.9
business 30.4
happy 30.1
adult 28.8
office 28.3
laptop 26.4
men 25.8
computer 25.7
groom 25.5
together 25.4
work 25.2
worker 24.1
sitting 23.2
couple 22.6
smiling 22.4
businesswoman 21.8
professional 21.4
women 21.4
job 21.2
working 21.2
meeting 20.7
home 19.9
businesspeople 19.9
corporate 19.8
suit 19.1
desk 18.9
senior 18.7
casual 18.6
indoors 18.4
portrait 18.1
team 17.9
modern 17.5
table 17.4
bow tie 17.3
talking 17.1
smile 17.1
grandma 16.7
colleagues 16.5
happiness 16.5
executive 16.3
handsome 15.2
necktie 14.9
clothing 14.8
group 14.5
lifestyle 14.5
manager 14
teamwork 13.9
cheerful 13.8
grandfather 13.8
20s 13.7
indoor 13.7
waiter 13.7
success 13.7
looking 13.6
mature 13
room 12.9
successful 12.8
face 12.8
older 12.6
elderly 12.4
employee 12.2
occupation 11.9
day 11.8
having 11.6
mid adult 11.6
holding 11.6
boss 11.5
color 11.1
two 11
25 30 years 10.8
husband 10.6
formal 10.5
attractive 10.5
ethnic 10.5
wife 10.4
dining-room attendant 10.2
communication 10.1
casual clothing 9.8
old 9.8
busy 9.6
30s 9.6
kin 9.5
love 9.5
presentation 9.3
human 9
technology 8.9
coworkers 8.8
businessmen 8.8
businessperson 8.8
two people 8.7
leader 8.7
bright 8.6
enjoying 8.5
finance 8.4
drink 8.4
hand 8.4
meal 8.3
care 8.2
alone 8.2
dress 8.1
hall 8.1
garment 8
family 8
medical 7.9
associates 7.9
jacket 7.7
expression 7.7
staff 7.7
building 7.6
marriage 7.6
adults 7.6
plan 7.6
coat 7.5
life 7.4
restaurant 7.4
confident 7.3
engineer 7.1
bride 7

Google
created on 2022-02-11

Black 89.7
Black-and-white 86.5
Style 84
Smile 82.9
Tableware 76.2
Vintage clothing 76.1
Monochrome photography 73.5
Tie 72.7
Monochrome 72.5
Event 70.9
Sitting 67.3
Room 66.2
Suit 63.9
Table 63.2
History 62.5
Stock photography 62.1
Flag 57.7
Photographic paper 57.7
Wine glass 53
Font 52

Microsoft
created on 2022-02-11

person 97.5
text 96.9
human face 95.7
smile 95
clothing 93.9
window 85.8
man 84.2
old 76.4

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 99.7%
Happy 63.5%
Surprised 20.6%
Calm 9.9%
Sad 3.7%
Angry 1%
Disgusted 0.6%
Confused 0.5%
Fear 0.3%

AWS Rekognition

Age 25-35
Gender Male, 80.9%
Calm 99.8%
Surprised 0.1%
Sad 0%
Disgusted 0%
Confused 0%
Happy 0%
Angry 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Tie 67.2%

Captions

Microsoft

a vintage photo of a person 95%
a vintage photo of a man and woman sitting next to a window 75.5%
a vintage photo of a man and woman posing for a picture 75.4%

Text analysis

Amazon

9
MJI7--YT3--

Google

MJIA-
RA°2-
MJIA- -YT RA°2- -XAGON
-YT
-XAGON