Human Generated Data

Title

Untitled (portrait of police officers in front of station, Derry, NH)

Date

1950

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18367

Human Generated Data

Title

Untitled (portrait of police officers in front of station, Derry, NH)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Human 97.3
Person 97.1
Person 96.5
Person 94.5
Person 91.1
Clothing 90.7
Apparel 90.7
Person 84.7
Crowd 84.4
People 82.6
Overcoat 82.1
Suit 82.1
Coat 82.1
Person 80.5
Indoors 74.6
Room 68.3
Chair 66.1
Furniture 66.1
Person 65.1
Shorts 60
Military Uniform 57.9
Military 57.9
Costume 56.9
Building 55.1
Housing 55.1
Dress 55

Imagga
created on 2022-03-04

glass 52.1
wineglass 41.7
perfume 40.8
bottle 37.2
toiletry 30.1
container 25.4
water 25.3
drink 24.2
beaker 22.8
glasses 22.2
party 21.5
vessel 20.3
alcohol 18.1
crystal 16.9
table 16.7
beverage 16.6
liquid 16.6
restaurant 16.6
celebration 15.9
medical 15
h2o 14.7
luxury 14.6
laboratory 14.5
aqua 14.3
science 14.2
clear 13.9
wedding 13.8
lab 13.6
wine 13.6
transparent 13.4
research 13.3
champagne 13.1
flask 12.8
glassware 12.7
experiment 12.7
chemistry 12.6
chemical 12.5
cool 12.4
biology 12.3
medicine 12.3
pharmacy 11.6
decoration 11.6
interior 11.5
drops 11.3
equipment 11
romantic 10.7
scientific 10.7
cold 10.3
jar 10.3
closeup 10.1
dinner 10.1
celebrate 9.9
pop bottle 9.9
pharmacology 9.9
wet 9.8
fresh 9.8
scientist 9.8
pharmaceutical 9.8
decor 9.7
new 9.7
close 9.7
instrument 9.6
design 9.6
development 9.5
service 9.3
festive 9.2
year 9.1
texture 9
tube 9
empty 8.9
biotechnology 8.8
sample 8.7
toast 8.7
setting 8.7
test 8.7
elegant 8.6
dining 8.6
tool 8.4
case 8.4
event 8.3
surface 7.9
holiday 7.9
bubbly 7.9
acid 7.9
banquet 7.8
reception 7.8
life 7.8
clinical 7.8
napkin 7.8
discovery 7.8
fluid 7.8
measure 7.7
eve 7.6
plate 7.6
rain 7.5
anniversary 7.5
place 7.4
bar 7.4
color 7.2
romance 7.1
antique 7.1
silver 7.1
room 7

Google
created on 2022-03-04

Window 94.1
White 92.2
Dress 89.6
Black 89.5
Style 83.9
Black-and-white 81.9
Line 81.8
Building 81
House 78.2
Monochrome photography 75.8
Chair 75.1
Vintage clothing 72.8
Monochrome 72.4
Event 72.2
Suit 71.4
Classic 71.3
Font 70.6
Symmetry 70.6
Uniform 69.3
Rectangle 68.5

Microsoft
created on 2022-03-04

person 92.6
window 86
text 81
white 73.4
black 72.4
clothing 68.1
black and white 66.4
old 60.3

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 99.7%
Happy 30.1%
Confused 26.2%
Calm 15.5%
Sad 15.2%
Surprised 3.9%
Fear 3.6%
Disgusted 3.4%
Angry 2%

AWS Rekognition

Age 36-44
Gender Female, 95.9%
Sad 39.4%
Angry 28.5%
Calm 8.9%
Confused 6.9%
Disgusted 6%
Surprised 5.9%
Happy 3.1%
Fear 1.4%

AWS Rekognition

Age 36-44
Gender Male, 99.8%
Calm 98.2%
Sad 0.6%
Happy 0.5%
Surprised 0.3%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 24-34
Gender Male, 95%
Calm 42.3%
Happy 29%
Confused 9%
Surprised 8%
Sad 5.4%
Angry 2.6%
Disgusted 2.3%
Fear 1.4%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 86.5%
Happy 5.8%
Confused 2.8%
Surprised 1.5%
Sad 1.4%
Angry 1.1%
Disgusted 0.8%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Female, 95.2%
Fear 88.2%
Happy 7.8%
Surprised 1.2%
Calm 0.9%
Disgusted 0.6%
Confused 0.6%
Angry 0.4%
Sad 0.2%

AWS Rekognition

Age 27-37
Gender Male, 97%
Surprised 43.3%
Fear 38.9%
Calm 11%
Confused 2.7%
Angry 1.5%
Disgusted 1.1%
Sad 0.9%
Happy 0.6%

AWS Rekognition

Age 24-34
Gender Female, 82.4%
Fear 45.1%
Sad 32.7%
Confused 12.1%
Calm 4.9%
Surprised 2.1%
Disgusted 1.5%
Angry 1.1%
Happy 0.5%

AWS Rekognition

Age 36-44
Gender Male, 88.6%
Fear 71.2%
Calm 22.9%
Sad 2.8%
Surprised 1.2%
Disgusted 1.2%
Happy 0.3%
Angry 0.2%
Confused 0.2%

AWS Rekognition

Age 42-50
Gender Male, 90.9%
Happy 66.1%
Sad 12%
Angry 6.5%
Disgusted 5.2%
Surprised 4%
Fear 2.8%
Calm 2.7%
Confused 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 97.1%

Captions

Microsoft

a group of people standing next to a window 81.1%
a group of people standing in front of a window 79%
a group of men standing next to a window 71.9%

Text analysis

Amazon

SID
KODVK-SVEEIA

Google

SIA
SIA