Human Generated Data

Title

Untitled (man and woman standing in doorway)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16419

Human Generated Data

Title

Untitled (man and woman standing in doorway)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Human 98.7
Person 98.7
Clothing 98.4
Apparel 98.4
Person 94.1
Coat 75.7
Overcoat 75.7
Bag 73.5
Suit 64.2
Shorts 63.3
Accessory 62.1
Accessories 62.1
Tie 62.1
Door 59.6
Sleeve 58.5
Tuxedo 55.9
Shoe 55.7
Footwear 55.7
Home Decor 55.7

Imagga
created on 2022-02-11

male 35.5
man 33.6
person 32.3
portrait 31.1
adult 30.2
people 30.1
happy 28.8
business 26.7
nurse 25.6
businessman 25.6
office 24.9
suit 24.8
professional 24.5
smiling 21.7
corporate 20.6
clothing 20.5
standing 20
job 19.5
worker 19.4
executive 19.4
smile 19.2
looking 19.2
work 18.1
men 18
casual 17.8
room 17.1
coat 17.1
lifestyle 16.6
garment 16.4
businesspeople 16.1
home 16
indoors 15.8
senior 15
happiness 14.9
attractive 14.7
occupation 14.7
lab coat 14.5
doctor 14.1
mature 13.9
medical 13.2
employee 13.2
couple 13.1
manager 13
camera 12.9
successful 12.8
indoor 12.8
confident 12.7
secretary 12.7
one 12.7
old 12.5
handsome 12.5
face 12.1
success 12.1
pretty 11.9
alone 11.9
women 11.9
human 11.2
modern 11.2
day 11
hospital 10.9
clinic 10.8
stethoscope 10.7
working 10.6
medicine 10.6
cheerful 10.6
elderly 10.5
career 10.4
businesswoman 10
student 10
aged 10
building 9.8
health 9.7
mid adult 9.6
waiter 9.5
communication 9.2
phone 9.2
friendly 9.1
holding 9.1
30s 8.7
desk 8.5
shirt 8.4
teamwork 8.3
inside 8.3
practitioner 8.3
20s 8.2
uniform 8.2
care 8.2
lady 8.1
team 8.1
life 8
computer 8
black 7.9
together 7.9
bright 7.9
education 7.8
color 7.8
1 7.7
workplace 7.6
dining-room attendant 7.6
adults 7.6
fashion 7.5
company 7.4
natural 7.4
girls 7.3
laptop 7.3
patient 7.2
sexy 7.2
door 7.1
cell 7.1
family 7.1
interior 7.1
look 7

Google
created on 2022-02-11

Microsoft
created on 2022-02-11

text 96.6
clothing 96.4
man 94.6
person 87.1
standing 80.5
drawing 79.5
posing 69.3
old 63.7

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 98.9%
Sad 63.6%
Happy 21.8%
Confused 6.4%
Surprised 3.9%
Disgusted 1.4%
Fear 1.3%
Calm 0.8%
Angry 0.7%

AWS Rekognition

Age 41-49
Gender Female, 71.3%
Happy 78.3%
Calm 20.5%
Sad 0.3%
Disgusted 0.2%
Surprised 0.2%
Confused 0.2%
Angry 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Suit 64.2%
Tie 62.1%
Shoe 55.7%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 88.3%
a man and woman standing in front of a mirror posing for the camera 77.1%
a man that is standing in front of a mirror posing for the camera 77%

Text analysis

Amazon

3
H
MJI7--Y--

Google

MJIA- -YT3RA°2- -NAGON
-YT3RA°2-
MJIA-
-NAGON