Human Generated Data

Title

Untitled (family portrait, father with two sons and cat)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17001

Human Generated Data

Title

Untitled (family portrait, father with two sons and cat)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 97.9
Person 97.9
Person 97.9
Person 97.4
Apparel 87.6
Clothing 87.6
Clinic 85.2
People 84.8
Tie 66.4
Accessories 66.4
Accessory 66.4
Tie 65.7
Furniture 64.9
Bed 64.9
Coat 62.4
Doctor 62.3
Hospital 59.3
Face 57.8
Photography 57.8
Photo 57.8
Portrait 57.8

Imagga
created on 2022-02-26

lab coat 100
coat 100
man 49.1
garment 47.4
male 41.2
adult 36.3
clothing 34.4
people 34.1
person 33.8
doctor 30.1
professional 29.8
businessman 28.3
office 27.3
business 26.1
medical 25.6
indoors 24.6
hospital 23.7
happy 22.6
mature 22.3
health 22.2
desk 21.7
clinic 21.5
smiling 20.3
indoor 20.1
portrait 20.1
looking 20
senior 19.7
casual 19.5
colleagues 19.4
computer 19.2
couple 19.2
elderly 19.2
businesspeople 19
men 18.9
team 18.8
patient 18.7
medicine 18.5
worker 18.5
job 17.7
home 17.6
camera 16.6
lifestyle 16.6
care 16.5
color 16.1
corporate 15.5
handsome 15.2
working 15
bright 15
nurse 15
work 14.9
day 14.9
practitioner 14.7
sitting 14.6
laptop 14.6
face 14.2
happiness 14.1
old 13.9
occupation 13.8
20s 13.8
businesswoman 13.6
executive 13.5
horizontal 13.4
stethoscope 13.3
meeting 13.2
table 13
teamwork 13
glasses 13
smile 12.8
associates 12.8
suit 12.7
40s 12.7
30s 12.5
group 12.1
modern 11.9
two 11.9
room 11.9
doctors 11.8
coworkers 11.8
mid adult 11.6
uniform 11.5
cheerful 11.4
women 11.1
specialist 10.9
groom 10.8
clinical 10.8
discussion 10.7
corporation 10.6
profession 10.5
treatment 10.1
discussing 9.8
healing 9.8
attractive 9.8
businessmen 9.8
together 9.6
illness 9.5
inside 9.2
forties 8.8
good mood 8.8
diagnosis 8.8
look 8.8
assistant 8.8
busy 8.7
using 8.7
talking 8.6
human 8.3
confident 8.2
technology 8.2
clinician 7.9
general practitioner 7.9
business people 7.9
30 35 years 7.9
examining 7.8
25 30 years 7.8
standing 7.8
consultant 7.8
examination 7.8
lab 7.8
expertise 7.8
2 7.8
laboratory 7.7
exam 7.7
hand 7.6
adults 7.6
manager 7.5
light 7.4
aged 7.2
interior 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 97.5
clothing 96.3
person 95.8
human face 92.6
man 81.8
smile 68.7
people 56.7
posing 52.9
cartoon 50.6
old 50.2

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Male, 57.2%
Happy 55.5%
Calm 15%
Surprised 10.5%
Angry 7.8%
Fear 6.7%
Sad 2.5%
Disgusted 1.2%
Confused 0.7%

AWS Rekognition

Age 36-44
Gender Male, 99.8%
Calm 42.4%
Sad 19.5%
Surprised 17.2%
Happy 8.7%
Disgusted 3.9%
Angry 3.5%
Fear 2.5%
Confused 2.4%

AWS Rekognition

Age 29-39
Gender Male, 99.6%
Calm 94.4%
Surprised 3.3%
Happy 1.2%
Disgusted 0.4%
Sad 0.3%
Fear 0.2%
Angry 0.2%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.9%
Tie 66.4%
Bed 64.9%

Captions

Microsoft

a group of people posing for a photo 97%
a group of people posing for the camera 96.9%
a group of people posing for a picture 96.8%

Text analysis

Amazon

5
MJ17--Y3A--

Google

-
2
MJIヨ- -YTヨヨA°2--AQ
MJI
-YT
ヨヨ
A
°
AQ
--