Human Generated Data

Title

Untitled (family playing music together)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17057

Human Generated Data

Title

Untitled (family playing music together)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 98.7
Human 98.7
Person 98.7
Person 97.1
Person 96.3
Person 95.3
Leisure Activities 94.2
Musical Instrument 92.9
Musician 92.9
Person 89.8
Guitar 85.9
Interior Design 85.9
Indoors 85.9
Plant 82.4
Room 79.9
Living Room 73.9
Vase 72.5
Pottery 72.5
Jar 72.5
Potted Plant 72.3
Blossom 68.9
Flower 68.9
Sitting 66.9
Chair 64.7
Furniture 64.7
Flower Arrangement 63.2
People 62.9
Guitarist 60.6
Performer 60.6
Portrait 60.2
Face 60.2
Photography 60.2
Photo 60.2
Senior Citizen 57.4
Monitor 57.2
Electronics 57.2
Screen 57.2
Display 57.2

Imagga
created on 2022-02-26

musical instrument 34.1
table 33
man 30.9
people 29.6
room 28.3
person 26.4
meeting 24.5
wind instrument 23.8
male 23.4
business 23.1
group 21.8
adult 19.7
office 19.5
interior 19.5
businessman 19.4
chair 19.1
work 18.8
restaurant 18.2
men 18
sitting 18
team 17.9
indoors 17.6
women 17.4
teacher 17.2
home 16.7
together 16.6
smiling 16.6
classroom 16.3
communication 15.9
couple 15.7
happy 15
accordion 14.7
modern 14
glass 14
brass 13.8
conference 13.7
computer 13.6
businesswoman 13.6
talking 13.3
professional 13
lifestyle 13
cheerful 13
desk 12.5
businesspeople 12.3
education 12.1
corporate 12
laptop 12
keyboard instrument 11.8
generator 11.8
holding 11.5
percussion instrument 11.4
smile 11.4
worker 11.4
dinner 11.4
executive 11.3
teamwork 11.1
indoor 11
student 10.6
friends 10.3
mature 10.2
happiness 10.2
house 10
drink 10
cafeteria 9.8
colleagues 9.7
lunch 9.5
party 9.5
coffee 9.3
meal 9.2
wine 9.2
board 9.2
suit 9
food 8.6
workplace 8.6
dining 8.6
study 8.4
manager 8.4
service 8.3
outfit 8
to 8
working 8
waiter 7.9
day 7.8
students 7.8
class 7.7
drinking 7.6
togetherness 7.5
document 7.5
showing 7.5
hall 7.5
friendship 7.5
presentation 7.4
floor 7.4
teenager 7.3
confident 7.3
looking 7.2
kitchen 7.2
salon 7.1
handsome 7.1
job 7.1
educator 7

Google
created on 2022-02-26

Black 89.6
Picture frame 89.1
Black-and-white 84.5
Style 83.8
Table 81.8
Curtain 81.3
Chair 75.9
Vintage clothing 75.3
Art 75.2
Event 74.1
Suit 73.5
Monochrome photography 73.2
Monochrome 70.9
Tableware 65.8
Sitting 65.3
History 65.3
Room 65.2
Stock photography 61.7
Classic 60.5
Paper product 53.9

Microsoft
created on 2022-02-26

person 98.8
text 95
indoor 92.8
clothing 85.7
musical instrument 77
man 70.3
group 60.6

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Female, 71.9%
Calm 95.7%
Confused 1.9%
Surprised 1.3%
Happy 0.6%
Sad 0.3%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 16-24
Gender Female, 97.2%
Calm 95.2%
Sad 1.6%
Surprised 1%
Fear 0.5%
Confused 0.5%
Happy 0.4%
Disgusted 0.4%
Angry 0.4%

AWS Rekognition

Age 14-22
Gender Female, 95.3%
Calm 89.9%
Sad 5.5%
Fear 1.8%
Surprised 1.5%
Disgusted 0.4%
Happy 0.3%
Confused 0.3%
Angry 0.2%

AWS Rekognition

Age 25-35
Gender Male, 93.4%
Calm 99.6%
Happy 0.1%
Confused 0.1%
Surprised 0.1%
Sad 0.1%
Disgusted 0%
Angry 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a group of people in a room 96.5%
a group of people standing in a room 95.4%
a group of people around each other 88.1%

Text analysis

Amazon

DRY
NONFAT
maxwell
BOOK
INSTANT
5
The
NONFAT DRY MI
ITLE
-
MI
- -
maxwell ASTES
7
Zeeps -
NOTE
Y
ASTES
DE - Summer NOTE محمد
A Y -
D
محمد
Zeeps
A
DE
Paste
Summer
COMMISSION

Google

NONFAT
NONFAT DRY M
M
DRY