Human Generated Data

Title

Untitled (three woman gathered around man at decorated desk)

Date

1948

People

Artist: John Deusing, American active 1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1556

Human Generated Data

Title

Untitled (three woman gathered around man at decorated desk)

People

Artist: John Deusing, American active 1940s

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99.1
Person 99.1
Person 98.4
Person 98.1
Accessories 97.3
Accessory 97.3
Tie 97.3
Person 95.2
Clothing 94.1
Apparel 94.1
Female 88.7
Dress 84.4
Indoors 81.4
Suit 81.4
Overcoat 81.4
Coat 81.4
Face 80.8
Kid 76.3
Child 76.3
Blonde 76.3
Girl 76.3
Teen 76.3
Woman 76.3
Room 73.3
People 68.5
Table 65.9
Furniture 65.9
Photo 65.6
Portrait 65.6
Photography 65.6
Shirt 65
Electronics 64.2
Screen 59.1
Display 56.5
Monitor 56.5

Imagga
created on 2021-12-14

grandma 59.2
senior 49.7
person 37.8
people 34.6
elderly 34.5
man 34.3
happy 33.8
mature 31.6
male 30.5
adult 29.7
couple 28.7
smiling 28.2
indoors 28.1
old 27.9
home 27.1
retired 26.2
retirement 22.1
sitting 20.6
older 19.4
together 19.3
computer 19.3
casual 18.6
husband 18.1
portrait 18.1
happiness 17.2
wife 16.1
office 16.1
lifestyle 15.9
smile 15.7
men 15.5
cheerful 15.4
looking 15.2
patient 14.8
laptop 14.6
women 14.2
day 14.1
60s 13.7
love 13.4
business 13.4
businessman 13.2
camera 12.9
hair 12.7
aged 12.7
health 12.5
grandfather 12.2
active 12.1
gray hair 11.8
professional 11.8
horizontal 11.7
age 11.4
mother 10.9
gray 10.8
family 10.7
nurse 10.7
medical 10.6
color 10.6
enjoying 10.4
clothing 10
face 9.9
holding 9.9
70s 9.8
seniors 9.8
handsome 9.8
executive 9.8
half length 9.7
two people 9.7
married 9.6
education 9.5
healthy 9.4
desk 9.4
glasses 9.3
drink 9.2
leisure 9.1
indoor 9.1
teacher 9
fun 9
romance 8.9
senior adult 8.9
middle aged 8.8
blond 8.7
using 8.7
30s 8.7
drinking 8.6
modern 8.4
room 8.4
human 8.2
worker 8.2
world 8.2
pensioner 8.2
romantic 8
classroom 8
to 8
scholar 7.9
sixties 7.8
hospital 7.8
casual clothing 7.8
teaching 7.8
corporate 7.7
affection 7.7
pretty 7.7
illness 7.6
two 7.6
togetherness 7.6
friendship 7.5
technology 7.4
teamwork 7.4
care 7.4
inside 7.4
coat 7.3
success 7.2
lab coat 7.1
groom 7.1
job 7.1
working 7.1

Google
created on 2021-12-14

Black 89.7
Black-and-white 86.8
Style 84.1
Smile 81.6
Rectangle 81
Font 80.4
Adaptation 79.3
People 77.7
Suit 77.1
Monochrome photography 76.5
Art 75.8
Tie 75.8
Happy 73.2
Monochrome 73.1
Event 71.3
Vintage clothing 69.4
Room 69
Visual arts 67.1
Stock photography 65.2
Eyewear 65.1

Microsoft
created on 2021-12-14

text 99.3
person 94.1
clothing 91.8
black and white 76.1
woman 52.9

Face analysis

Amazon

Google

AWS Rekognition

Age 49-67
Gender Male, 52.6%
Calm 48.1%
Sad 36%
Confused 7.1%
Happy 4.7%
Surprised 1.6%
Angry 1.4%
Fear 0.7%
Disgusted 0.5%

AWS Rekognition

Age 26-40
Gender Male, 92.1%
Calm 41.6%
Happy 28.9%
Sad 27.9%
Angry 0.8%
Confused 0.5%
Surprised 0.3%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 46-64
Gender Female, 73.3%
Calm 96.3%
Sad 1.6%
Surprised 1.3%
Confused 0.3%
Angry 0.3%
Happy 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 22-34
Gender Male, 77.7%
Calm 60.8%
Sad 20.6%
Confused 9.5%
Happy 6.2%
Angry 0.8%
Surprised 0.8%
Disgusted 0.7%
Fear 0.6%

AWS Rekognition

Age 36-54
Gender Female, 70.1%
Calm 91.4%
Happy 7%
Sad 0.8%
Surprised 0.5%
Angry 0.2%
Confused 0.1%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Tie 97.3%

Captions

Microsoft

a person standing in front of a window 70.6%
a group of people posing for the camera 70.5%
a group of people standing in front of a window 64.1%

Text analysis

Amazon

FEMALE
3
-FRANK
No./ FEMALE
G.R.G.
No./
....
-FRANK SINAH
G.R.G. wwo
SINAH
wwo

Google

GRE WEOS FRAN SA .I FEMALE
FRAN
SA
FEMALE
GRE
WEOS
.I