Human Generated Data

Title

Untitled (Dr. Herman M. Juergens talking with patient in exam room)
Date

1965-1968
People

Artist: Gordon W. Gahan, American 1945 - 1984
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.2.486.2

Human Generated Data

Title

Untitled (Dr. Herman M. Juergens talking with patient in exam room)

People

Artist: Gordon W. Gahan, American 1945 - 1984

Date

1965-1968

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.2.486.2

Machine Generated Data

Tags

Amazon
created on 2023-10-25

Photography 99.8
Adult 99.6
Male 99.6
Man 99.6
Person 99.6
Adult 99.6
Male 99.6
Man 99.6
Person 99.6
Clothing 99.4
Shirt 99.4
Face 98.5
Head 98.5
Portrait 98.5
Coat 95.5
Jacket 95.5
Desk 94.1
Furniture 94.1
Table 94.1
Body Part 93.9
Finger 93.9
Hand 93.9
Accessories 85.1
Glasses 85.1
Conversation 81.5
Clinic 81
Pen 79.1
Sitting 73.6
Indoors 73.4
Glasses 62.7
Interview 57.1
Architecture 56.8
Building 56.8
Hospital 56.8
Reading 56.5
Computer 56
Electronics 56
Pc 56
Formal Wear 55.8
Tie 55.8
Dress Shirt 55.7
Computer Hardware 55.5
Hardware 55.5
Bag 55.3
Handbag 55.3
Laptop 55.1

Clarifai
created on 2018-10-07

people 99.3
adult 99
man 98.9
one 96.7
portrait 96.1
facial expression 91.1
monochrome 90.5
furniture 90.2
business 88.7
office 88.7
wear 87.5
sit 87.4
desk 87.2
actor 87.1
two 86.1
room 85.8
sitting 84.7
telephone 83.8
technology 83.6
indoors 83.3

Imagga
created on 2018-10-07

computer 43.5
laptop 42.2
home 39.1
person 38.9
adult 34.6
sitting 33.5
man 31.6
office 31
indoors 29.9
people 29
business 27.9
male 27
room 26.4
work 25.1
smiling 24.6
working 23.9
desk 22.7
happy 22.6
notebook 21
professional 19.8
lifestyle 19.5
job 18.6
couch 18.4
indoor 18.3
executive 17.7
portrait 17.5
smile 17.1
interior 16.8
corporate 16.3
looking 15.2
women 15
table 14.5
chair 14.5
casual 14.4
technology 14.1
businesswoman 13.6
sofa 13.6
personal computer 13.4
house 13.4
worker 13.3
living 13.3
businessman 13.2
patient 13.2
senior 13.1
mature 13
relaxing 12.7
attractive 12.6
reading 12.4
keyboard 12.2
one 11.9
modern 11.9
portable computer 11.7
meeting 11.3
teacher 11
occupation 11
suit 11
alone 11
relax 11
communication 10.9
relaxation 10.9
living room 10.8
seated 10.7
engineer 10.7
color 10.6
one person 10.4
relaxed 10.3
men 10.3
manager 10.2
book 10.2
student 10.2
phone 10.1
group 9.7
mid adult 9.6
resting 9.5
education 9.5
digital computer 9.4
face 9.2
confident 9.1
cheerful 8.9
to 8.8
screen 8.8
paper 8.7
case 8.7
1 8.7
happiness 8.6
elderly 8.6
monitor 8.6
career 8.5
pretty 8.4
horizontal 8.4
lady 8.1
success 8
call 8
scholar 7.9
newspaper 7.9
30s 7.7
comfortable 7.6
hand 7.6
furniture 7.5
holding 7.4
coffee 7.4
inside 7.4
successful 7.3
cup 7.2
domestic 7.2
team 7.2
telephone 7.1
family 7.1
day 7.1

Google
created on 2018-10-07

white 96.5
black 95.8
photograph 95.6
man 95.5
person 92.9
black and white 89.4
photography 83.9
snapshot 81.8
monochrome photography 74.1
monochrome 73
human 72.5
human behavior 69
muscle 65.1
hand 63.1
gentleman 57.4
fun 53.1
conversation 51.6

Microsoft
created on 2018-10-07

person 99.9
man 97.4
indoor 91.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-62
Gender Male, 100%
Angry 69%
Calm 13.9%
Disgusted 7.7%
Surprised 6.9%
Fear 6.4%
Confused 5%
Sad 2.4%
Happy 1.2%

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult
Male
Man
Person
Jacket
Glasses
Pen
Handbag
Adult 99.6%
Adult 99.6%
Male 99.6%
Male 99.6%
Man 99.6%
Man 99.6%
Person 99.6%
Person 99.6%
Jacket 95.5%
Glasses 85.1%
Glasses 62.7%
Pen 79.1%
Handbag 55.3%

Captions

Microsoft
created on 2018-10-07

a man sitting at a desk 94%
a man sitting on a desk 91.2%
a man holding a laptop 85.7%

Text analysis

Amazon

...
G4