Human Generated Data

Title

Untitled
Date

20th century
People

Artist: Jo Ann Callis, American born 1940
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.194.1

Human Generated Data

Title

Untitled

People

Artist: Jo Ann Callis, American born 1940

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.194.1

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Tie 100
Accessories 100
Accessory 100
Clothing 99.9
Apparel 99.9
Shirt 99.6
Person 95.9
Human 95.9
Dress Shirt 87.2
Necktie 79
Suit 78.3
Coat 78.3
Overcoat 78.3

Clarifai
created on 2023-10-29

portrait 99.7
model 98.8
studio 97.4
people 97.2
man 97.2
fashion 96.8
tie 96.1
girl 95.9
business 94.2
one 94
face 93.4
smile 93
jacket 92.9
guy 92.8
professional 91
portfolio 89.3
shirt 89.2
adult 88.4
lid 86.3
actor 85.8

Imagga
created on 2022-02-26

garment 51.3
person 42.4
portrait 37.6
attractive 37.2
adult 36.4
sweatshirt 35.2
suit 35.2
people 34.1
clothing 33.9
coat 33.2
professional 29.8
pullover 28.1
confident 27.4
smile 27.1
business 26.8
pretty 26.6
doctor 24.5
stethoscope 23.9
smiling 23.9
happy 23.9
male 23.5
nurse 22.9
sweater 22.5
medical 22.1
model 21.8
man 21.5
corporate 21.5
trench coat 21.3
face 20.6
one 20.2
brunette 20.1
friendly 19.3
standing 19.2
handsome 18.8
lady 18.7
worker 18.4
fashion 18.1
hospital 17.9
casual 17.8
office 17.7
medicine 17.6
executive 17.5
studio 17.5
hair 17.5
jacket 17.4
businesswoman 17.3
raincoat 17
posing 16.9
job 16.8
student 16.7
lab coat 16.4
uniform 16.4
success 16.1
sexy 16.1
shirt 16.1
looking 16
lifestyle 15.9
successful 15.6
expression 15.4
career 15.2
smart 15.1
care 14.8
eyes 14.7
health 14.6
clinic 14.4
cute 14.4
pose 13.6
guy 13.4
work 13.4
businessman 13.3
help 13.1
alone 12.8
human 12.8
women 12.7
tie 12.4
specialist 12.2
black 12
modern 11.9
physician 11.7
single 11.5
wearing 11.4
cheerful 11.4
practitioner 10.9
profession 10.5
look 10.5
necktie 9.7
adolescent 9.7
confidence 9.6
employee 9.6
serious 9.6
illness 9.6
businesspeople 9.5
youth 9.4
positive 9.2
body 8.8
staff 8.6
communication 8.4
glasses 8.4
holding 8.3
occupation 8.3
20s 8.3
healthy 8.2
covering 8.2
technology 8.2
style 8.2
gorgeous 8.2
surgeon 8
happiness 7.9
juvenile 7.8
boy 7.8
clinical 7.8
formal 7.7
stole 7.5
phone 7.4
laptop 7.3
fresh 7.2
consumer goods 7.1
indoors 7

Google
created on 2022-02-26

Shoulder 93.8
Dress shirt 90.8
Sleeve 87.2
Collar 84.1
Street fashion 82.5
Flash photography 79
Eyewear 78.8
Fashion design 78.5
Blazer 78.3
Fashion model 77.9
Formal wear 76.8
Button 75.3
Smile 75.2
T-shirt 75.2
Tie 74.3
Hat 72.2
Beard 68.6
White-collar worker 68.1
Fashion accessory 67.4
Jersey 65.1

Microsoft
created on 2022-02-26

person 98.7
shirt 98.3
man 97.3
wall 96.6
indoor 95.6
clothing 95.4
text 92.2
human face 87.7
smile 86.7
tie 86.6
fashion 85.3
collar 83.6
sleeve 80.6
dress shirt 80.1
posing 77.7
white 68
outerwear 60.6
top 56.2
pocket 52.1
trousers 51.8
jacket 50.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Female, 86.8%
Happy 48.7%
Fear 26.8%
Sad 15.4%
Surprised 3%
Disgusted 2.6%
Confused 1.8%
Angry 1.3%
Calm 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie
Person
Suit
Tie 100%
Person 95.9%
Suit 78.3%

Categories

Imagga

events parties 92.9%
people portraits 6.8%

Captions

Microsoft
created on 2022-02-26

a person posing for the camera 97.9%
a man posing for a photo 94.2%
a man posing for the camera 94.1%