Human Generated Data

Title

Untitled (West Allis football team)

Date

1948

People

Artist: John Deusing, American active 1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1811

Human Generated Data

Title

Untitled (West Allis football team)

People

Artist: John Deusing, American active 1940s

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.7
Human 99.7
Person 96.6
Person 96.1
People 94.5
Person 92.3
Person 91.4
Person 88.6
Person 87.9
Apparel 86.2
Clothing 86.2
Person 85.1
Person 80.2
Person 78.3
Sports 76.3
Sport 76.3
Team 74.8
Team Sport 74.7
Football 66
Person 61.3
Shorts 59.9
Overcoat 55.2
Coat 55.2
Suit 55.2
Person 44.5

Imagga
created on 2021-12-14

snow 46.9
winter 27.2
graffito 25.3
grunge 23
cold 22.4
weather 22.1
decoration 22.1
picket fence 21.6
landscape 21.6
ice 21.4
fence 21
structure 19.3
sky 19.1
frozen 18.1
drawing 15.7
scene 14.7
water 14.7
texture 14.6
frost 14.4
sketch 13.8
design 13.5
city 13.3
season 13.2
barrier 13.1
trees 12.4
architecture 11.7
mountain 11.6
pattern 11.6
black 11.4
space 10.9
tree 10.8
snowy 10.7
outdoors 10.4
antique 10.4
business 10.3
construction 10.3
art 10.2
wall 10
frame 10
paint 10
outdoor 9.9
silhouette 9.9
vintage 9.9
cool 9.8
old 9.7
rural 9.7
forest 9.6
scenics 9.6
grungy 9.5
graphic 9.5
paper 9.5
day 9.4
tranquil 9
aged 9
scenery 9
backgrounds 8.9
obstruction 8.8
seasonal 8.8
symbol 8.7
urban 8.7
natural 8.7
rough 8.2
retro 8.2
ski 8
surface 7.9
scenic 7.9
text 7.9
clear 7.8
icy 7.8
color 7.8
freeze 7.8
travel 7.7
house 7.5
sign 7.5
wood 7.5
park 7.4
building 7.3
group 7.3
crystal 7.2
drop 7.2
dirty 7.2
horizon 7.2
material 7.1
negative 7.1
representation 7.1
sea 7
textured 7

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

posing 97.3
text 96
grass 95.9
group 83.8
black 79.6
standing 76.5
old 73.5
person 72.4
team 67.1
white 62.3
black and white 59.7

Face analysis

Amazon

Google

AWS Rekognition

Age 49-67
Gender Female, 53.3%
Sad 31.7%
Calm 29.8%
Happy 26.6%
Fear 6%
Angry 2.3%
Disgusted 2.1%
Confused 1.2%
Surprised 0.3%

AWS Rekognition

Age 24-38
Gender Male, 72.7%
Calm 89.8%
Happy 3.7%
Disgusted 3.2%
Sad 1.6%
Angry 0.6%
Confused 0.5%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 22-34
Gender Male, 92.6%
Calm 96%
Happy 3.4%
Sad 0.2%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 13-23
Gender Male, 93.9%
Calm 40.7%
Happy 39.3%
Sad 17.3%
Fear 1.2%
Confused 0.5%
Disgusted 0.4%
Surprised 0.3%
Angry 0.3%

AWS Rekognition

Age 33-49
Gender Female, 59.7%
Calm 69.8%
Disgusted 8%
Happy 6%
Sad 5.3%
Fear 4.2%
Surprised 4%
Confused 1.4%
Angry 1.3%

AWS Rekognition

Age 43-61
Gender Male, 74.4%
Calm 82%
Sad 10.4%
Happy 5.1%
Angry 0.8%
Fear 0.6%
Disgusted 0.5%
Confused 0.3%
Surprised 0.3%

AWS Rekognition

Age 21-33
Gender Male, 98.1%
Calm 94.7%
Happy 3.5%
Surprised 0.8%
Angry 0.4%
Confused 0.2%
Sad 0.2%
Disgusted 0.2%
Fear 0%

AWS Rekognition

Age 28-44
Gender Male, 81.5%
Calm 84.6%
Happy 9.5%
Sad 4.5%
Confused 0.7%
Angry 0.3%
Surprised 0.2%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 23-35
Gender Male, 86.6%
Calm 74.8%
Angry 6.2%
Happy 6.2%
Surprised 5.2%
Sad 2.8%
Confused 2.1%
Disgusted 1.8%
Fear 1.1%

AWS Rekognition

Age 21-33
Gender Female, 80.5%
Calm 53.2%
Happy 30.8%
Sad 6.8%
Angry 6.3%
Confused 1.3%
Surprised 0.8%
Fear 0.4%
Disgusted 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people posing for a photo 94.6%
a group of people posing for the camera 94.5%
an old photo of a group of people posing for the camera 92.2%

Text analysis

Amazon

34
55
49
49 42
53
42
30
29
45
24
20
32
31
38
22
23
21
33 21
33
36
37
25
VISITOR
4
WEST AL
2
5
T
40
50
h
48
13
5F
1
8+٢١
[

Google

23 24 WEST ALVISITOR 38 45 13 37 31 53 .30 48 34 55 4 25 30 20 22 29 55 49 42 32 33 21 36 4)
45
13
33
36
23
ALVISITOR
37
25
20
49
42
WEST
31
21
24
38
48
34
4
29
4)
53
.30
55
30
22
32