Human Generated Data

Title

Untitled (family with son and daughter posed in front of living room fireplace)
Date

1940
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9926

Human Generated Data

Title

Untitled (family with son and daughter posed in front of living room fireplace)

People

Artist: Martin Schweig, American 20th century

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9926

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 99.4
Human 99.4
Person 99.1
Person 98.5
Person 98.3
Clothing 97.8
Apparel 97.8
Tie 87.5
Accessories 87.5
Accessory 87.5
Tie 87.2
Face 87
Icing 77.4
Food 77.4
Dessert 77.4
Cake 77.4
Cream 77.4
Creme 77.4
Shirt 73.6
Sleeve 71
Sunglasses 67.2
Sunglasses 66.6
Portrait 64.9
Photography 64.9
Photo 64.9
People 62.4
Chef 59.8

Clarifai
created on 2023-10-27

people 99.8
group 99.3
adult 98.7
two 98.6
three 98
woman 97
man 96.4
wear 96
four 94.5
group together 94.1
facial expression 93.7
medical practitioner 91.9
several 91.9
five 91.7
portrait 90.6
medicine 88.2
employee 85.6
monochrome 85.3
education 83.1
science 82.4

Imagga
created on 2022-01-29

man 41.7
nurse 40.6
male 34.9
people 34.6
person 34.1
businessman 29.1
adult 27.6
business 26.7
patient 24.5
professional 21.5
men 21.5
office 21.1
smiling 20.2
worker 20.2
indoors 19.3
happy 18.8
colleagues 18.5
women 18.2
portrait 18.1
corporate 18
30s 17.3
job 16.8
medical 16.8
work 16.5
businesspeople 16.1
team 16.1
hospital 15.4
group 15.3
doctor 15
working 15
mature 14.9
couple 14.8
mid adult 14.5
coat 14.3
talking 14.3
desk 14.2
sitting 13.7
lifestyle 13.7
barbershop 13.7
businesswoman 13.6
room 13.5
smile 13.5
color 13.3
meeting 13.2
face 12.8
casual 12.7
happiness 12.5
shop 12.4
senior 12.2
waiter 12.1
case 12
indoor 11.9
lab coat 11.7
clothing 11.4
clinic 11.4
home 11.2
employee 11.1
20s 11
sick person 10.6
profession 10.5
modern 10.5
health 10.4
career 10.4
executive 10.3
teamwork 10.2
associates 9.8
coworkers 9.8
groom 9.8
40s 9.7
to 9.7
medicine 9.7
computer 9.6
four 9.6
standing 9.6
day 9.4
life 9.3
bright 9.3
horizontal 9.2
attractive 9.1
mercantile establishment 9.1
care 9.1
black 9
cheerful 8.9
handsome 8.9
looking 8.8
thirties 8.8
education 8.7
formal 8.6
two 8.5
manager 8.4
holding 8.3
mother 8.2
suit 8.2
family 8
table 7.8
communication 7.6
dining-room attendant 7.4
occupation 7.3
alone 7.3
laptop 7.3
success 7.2
interior 7.1
world 7.1
together 7

Google
created on 2022-01-29

Photograph 94.2
Smile 91.8
Sleeve 87.2
Black-and-white 84.9
Style 83.8
Hat 76
Snapshot 74.3
Monochrome photography 73.3
Monochrome 73
Nurse uniform 71.1
T-shirt 70.3
Event 69.1
Vintage clothing 67.4
Apron 63.7
Stock photography 63.7
Room 63.5
Service 63.1
Cooking 62.4
Uniform 62.1
Photographic paper 53.9

Microsoft
created on 2022-01-29

text 98
person 97.5
smile 91.9
clothing 90.6
human face 80.1
man 76
dance 71.4
black and white 58.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 91.3%
Happy 88.6%
Calm 8.5%
Sad 1.1%
Confused 0.5%
Surprised 0.4%
Fear 0.4%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 28-38
Gender Male, 98.7%
Calm 99.9%
Sad 0%
Surprised 0%
Disgusted 0%
Confused 0%
Angry 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 89%
Surprised 3.6%
Happy 3%
Angry 1.4%
Disgusted 1.2%
Confused 0.8%
Sad 0.7%
Fear 0.3%

AWS Rekognition

Age 25-35
Gender Female, 96.7%
Happy 96.1%
Surprised 3.1%
Calm 0.6%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%
Confused 0%
Sad 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Sunglasses
Person 99.4%
Person 99.1%
Person 98.5%
Person 98.3%
Tie 87.5%
Tie 87.2%
Sunglasses 67.2%
Sunglasses 66.6%

Text analysis

Amazon

EXI
MJIR
EXI the
MJIR YEST A70A
A70A
the
YEST
АЛОГИЕ
XIIO

Google

MJ13 YT33A 2 A3A
MJ13
YT33A
2
A3A